Mar 19 18:09:11.737556 np0000160124 systemd[1]: Started devstack@neutron-ovn-maintenance-worker.service - Devstack devstack@neutron-ovn-maintenance-worker.service.
Mar 19 18:09:13.382568 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.common.config [-] Logging enabled!
Mar 19 18:09:13.383426 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker version 28.1.0.dev29
Mar 19 18:09:13.383426 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=103710) setup_logging /opt/stack/neutron/neutron/common/config.py:124}}
Mar 19 18:09:13.383426 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.server.ovn_maintenance [-] OVN maintenance process starting...
Mar 19 18:09:13.383426 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "plugin-directory" by "neutron_lib.plugins.directory._create_plugin_directory" {{(pid=103710) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Mar 19 18:09:13.383426 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=103710) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Mar 19 18:09:13.383776 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.000s {{(pid=103710) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Mar 19 18:09:13.383776 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "manager" by "neutron.manager.NeutronManager._create_instance" {{(pid=103710) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Mar 19 18:09:13.383776 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=103710) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Mar 19 18:09:13.383776 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.manager [-] Loading core plugin: ml2
Mar 19 18:09:13.713717 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.713717 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.713717 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.securitygroup.SecurityGroup'>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.714328 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.714438 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.714438 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_group.AddressGroup'>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.755383 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.755605 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.755605 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.network.Network'>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.761945 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.762031 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.762083 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.qos.policy.QosPolicy'>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.783096 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.783187 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:13.783187 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.subnetpool.SubnetPool'>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.003790 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.003790 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.003790 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method RbacNeutronDbObjectMixin.validate_rbac_policy_change of <class 'neutron.objects.address_scope.AddressScope'>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.083015 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x771e394671a0> agent after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.083250 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _update_segment_host_mapping_for_agent at 0x771e394671a0> agent after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.083250 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _add_segment_host_mapping_for_segment at 0x771e39467240> segment precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.083250 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _delete_segments_for_network at 0x771e394672e0> network precommit_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.083451 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function _prevent_segment_delete_with_port_bound at 0x771e39484540> segment before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.142471 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._before_network_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> network before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.142740 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <function DVRDbMixin._delete_mac_associated_with_agent at 0x771e3944a660> agent before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.142740 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> network before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.142740 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> port before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.142740 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupDbMixin._ensure_default_security_group_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> port before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143072 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> segment precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143072 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> segment precommit_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143072 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> segment after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143072 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._handle_segment_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> segment after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143072 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> network after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143419 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._network_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> network precommit_delete 0, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143419 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._port_provisioned of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> port provisioning_complete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143419 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_create of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143419 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._process_ext_policy_delete of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> rbac-policy after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143419 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._retry_binding_revived_agents of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> agent after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143714 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_after_delete_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> subnet after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143714 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin._subnet_delete_precommit_handler of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> subnet precommit_delete 0, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143714 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143714 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method External_net_db_mixin._validate_ext_not_in_use_by_tenant of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.143714 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> segment_host_mapping after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.144073 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Ml2Plugin.delete_agent_notified of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> agent after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.144073 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.144073 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.144073 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.plugins.ml2.plugin.Ml2Plugin object at 0x771e39255eb0>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.144396 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=103710) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Mar 19 18:09:14.144396 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=103710) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Mar 19 18:09:14.144396 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=103710) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Mar 19 18:09:14.144653 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=103710) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Mar 19 18:09:14.144653 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=103710) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Mar 19 18:09:14.144653 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=103710) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Mar 19 18:09:14.144911 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'geneve']
Mar 19 18:09:14.145579 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['public']
Mar 19 18:09:14.146199 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete
Mar 19 18:09:14.146791 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict({'public': [(1, 4094)]})
Mar 19 18:09:14.146867 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'local', 'vlan']
Mar 19 18:09:14.147025 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'local', 'vlan'])
Mar 19 18:09:14.147098 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Project network_types: ['geneve']
Mar 19 18:09:14.147224 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security', 'qos']
Mar 19 18:09:14.147743 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security', 'qos']
Mar 19 18:09:14.147817 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security', 'qos']
Mar 19 18:09:14.147897 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['ovn']
Mar 19 18:09:14.216036 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['ovn']
Mar 19 18:09:14.216036 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['ovn']
Mar 19 18:09:14.216267 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] No mechanism drivers provide segment reachability information for agent scheduling.
Mar 19 18:09:14.219276 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x771e39327b30>> floatingip before_response 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.219276 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Notifier._send_nova_notification of <neutron.notifiers.nova.Notifier object at 0x771e39327b30>> port before_response 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:14.240962 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat'
Mar 19 18:09:14.240962 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete
Mar 19 18:09:14.241127 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve'
Mar 19 18:09:14.241235 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 65536)]
Mar 19 18:09:14.306247 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO dbcounter [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Registered counter for database neutron
Mar 19 18:09:14.326137 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_db.sqlalchemy.engines [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103710) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Mar 19 18:09:14.962849 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG dbcounter [-] [103710] Writer thread running {{(pid=103710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Mar 19 18:09:16.509295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.db.api [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Retry wrapper got retriable exception: (pymysql.err.IntegrityError) (1062, "Duplicate entry '1' for key 'ml2_geneve_allocations.PRIMARY'")
Mar 19 18:09:16.509295 np0000160124 neutron-ovn-maintenance-worker[103710]: [SQL: INSERT INTO ml2_geneve_allocations (geneve_vni, allocated) VALUES (%(geneve_vni)s, %(allocated)s)]
Mar 19 18:09:16.509295 np0000160124 neutron-ovn-maintenance-worker[103710]: [parameters: [{'geneve_vni': 1, 'allocated': 0}, {'geneve_vni': 2, 'allocated': 0}, {'geneve_vni': 3, 'allocated': 0}, {'geneve_vni': 4, 'allocated': 0}, {'geneve_vni': 5, 'allocated': 0}, {'geneve_vni': 6, 'allocated': 0}, {'geneve_vni': 7, 'allocated': 0}, {'geneve_vni': 8, 'allocated': 0}  ... displaying 10 of 100 total bound parameter sets ...  {'geneve_vni': 99, 'allocated': 0}, {'geneve_vni': 100, 'allocated': 0}]]
Mar 19 18:09:16.509295 np0000160124 neutron-ovn-maintenance-worker[103710]: (Background on this error at: https://sqlalche.me/e/20/gkpj) {{(pid=103710) wrapped /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/db/api.py:185}}
Mar 19 18:09:16.509295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_db.api [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Performing DB retry for function neutron.plugins.ml2.drivers.type_tunnel._TunnelTypeDriverBase._sync_allocations {{(pid=103710) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/api.py:155}}
Mar 19 18:09:17.371154 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Initializing driver for type 'local'
Mar 19 18:09:17.371357 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Initializing driver for type 'vlan'
Mar 19 18:09:17.484298 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] VlanTypeDriver initialization complete
Mar 19 18:09:17.484391 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Initializing extension driver 'port_security'
Mar 19 18:09:17.484494 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.extensions.port_security [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] PortSecurityExtensionDriver initialization complete
Mar 19 18:09:17.484591 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Initializing extension driver 'qos'
Mar 19 18:09:17.484683 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.plugins.ml2.extensions.qos [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QosExtensionDriver initialization complete {{(pid=103710) initialize /opt/stack/neutron/neutron/plugins/ml2/extensions/qos.py:31}}
Mar 19 18:09:17.484816 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Initializing mechanism driver 'ovn'
Mar 19 18:09:17.484949 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Starting OVNMechanismDriver
Mar 19 18:09:17.486581 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver.pre_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> process before_spawn 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.486696 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver.post_fork_initialize of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> process after_init 55550000, True {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.486796 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._add_segment_host_mapping_for_segment of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> segment after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.486859 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver.create_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> segment after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.486989 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver.delete_segment_provnet_port of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> segment after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487089 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._validate_allowed_address_pairs of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> allowed_address_pair before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487198 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._create_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> security_group precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487198 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._update_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> security_group after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487377 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._create_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> security_group after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487377 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> security_group precommit_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._delete_security_group of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> security_group after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._create_sg_rule_precommit of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> security_group_rule precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487672 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> security_group_rule after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487672 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._process_sg_rule_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> security_group_rule before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.487793 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> address_group after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.488042 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> address_group after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.488042 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNMechanismDriver._process_ag_notification of <neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver object at 0x771e391a1a60>> address_group after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.488383 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method DriverBase._register of <neutron.services.qos.drivers.ovn.driver.OVNQosDriver object at 0x771e3906a420>> qos_plugin after_init 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.488383 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNTrunkDriver.register of <neutron.services.trunk.drivers.ovn.trunk_driver.OVNTrunkDriver object at 0x771e37a40e30>> trunk_plugin after_init 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.488761 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method DriverBase._register of <neutron.services.logapi.drivers.ovn.driver.OVNDriver object at 0x771e37a40e60>> logging-plugin after_init 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.489011 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.services.logapi.drivers.ovn.driver [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] OVN logging driver registered
Mar 19 18:09:17.490726 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.plugins.ml2.plugin [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=103710) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Mar 19 18:09:17.490726 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a410d0>> port after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.490726 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a410d0>> port after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.490726 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a410d0>> port after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.490726 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a41040>> subnet after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.491580 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a41040>> subnet after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.491580 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a41040>> subnet after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.491580 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40fe0>> network after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.491580 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40fe0>> network after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.492195 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40fe0>> network after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.492195 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40fb0>> security_group after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.492195 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40fb0>> security_group after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.492195 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40fb0>> security_group after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.492711 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a41010>> security_group_rule after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.492711 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a41010>> security_group_rule after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.492711 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a41010>> security_group_rule after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.492711 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40f20>> address_group after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.493490 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40f20>> address_group after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.493490 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method _ObjectChangeHandler.handle_event of <neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler object at 0x771e37a40f20>> address_group after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.493490 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ML2 OVO RPC backend initialized. {{(pid=103710) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:117}}
Mar 19 18:09:17.493490 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.quota [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded quota_driver: <neutron.db.quota.driver_nolock.DbQuotaNoLockDriver object at 0x771e37a40ef0>.
Mar 19 18:09:17.493490 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.plugin [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Modular L2 Plugin initialization complete
Mar 19 18:09:17.493490 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading services supported by the core plugin {{(pid=103710) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:169}}
Mar 19 18:09:17.493490 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.plugins.ml2.managers [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Got port-security extension from driver 'port_security'
Mar 19 18:09:17.494642 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading service plugins: ['ovn-router', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=103710) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}}
Mar 19 18:09:17.494642 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading Plugin: ovn-router
Mar 19 18:09:17.500476 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._delete_router_remove_external_gateways of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x771e37a42ed0>> router before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.500595 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function L3RpcNotifierMixin._notify_gateway_port_ip_changed at 0x771e392bbe20> port after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.500684 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function L3RpcNotifierMixin._notify_routers_callback at 0x771e392bbce0> port after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.500809 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnet_gateway_ip_update at 0x771e392bbd80> subnet after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.500945 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function L3RpcNotifierMixin._notify_subnetpool_address_scope_update at 0x771e392bbec0> subnetpool_address_scope after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501032 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x771e38157060> port before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501114 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function OVNL3RouterPlugin._port_update at 0x771e38157060> port after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501194 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method L3_NAT_dbonly_mixin._precommit_delete_port_callback of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x771e37a42ed0>> port precommit_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501278 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_internal_ip_change_for_fip at 0x771e392a3d80> port before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501423 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback at 0x771e392a3ce0> port before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501519 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method RouterAvailabilityZoneMixin._process_az_request of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x771e37a42ed0>> router precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501603 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_create of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x771e37a42ed0>> router precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501686 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method ExtraGatewaysDbOnlyMixin._process_bfd_ecmp_update of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x771e37a42ed0>> router precommit_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.501789 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function OVNL3RouterPlugin._subnet_update at 0x771e38156fc0> subnet after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.502360 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.quota.resource_registry [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Tracking information for resource: router configured {{(pid=103710) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Mar 19 18:09:17.502436 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.quota.resource_registry [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Tracking information for resource: floatingip configured {{(pid=103710) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}}
Mar 19 18:09:17.502509 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.services.ovn_l3.plugin [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Starting OVNL3RouterPlugin
Mar 19 18:09:17.502703 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNPortForwarding.register of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x771e37a43da0>> port_forwarding_plugin after_init 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.502872 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method DriverController._check_router_request of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x771e37a42db0>> router before_create 55550100, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.502975 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method DriverController._clear_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x771e37a42db0>> router precommit_delete 55550100, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.503063 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method DriverController._set_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x771e37a42db0>> router precommit_create 55550100, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.503161 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method DriverController._update_router_provider of <neutron.services.ovn_l3.service_providers.driver_controller.DriverController object at 0x771e37a42db0>> router precommit_update 55550100, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.505608 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.services.provider_configuration [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Service providers = [] {{(pid=103710) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}}
Mar 19 18:09:17.505685 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.db.servicetype_db [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=103710) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}}
Mar 19 18:09:17.507407 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVN_L3_HA_db_mixin._precommit_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> router precommit_create 55549900, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507407 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_add_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> router_interface after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507407 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_floatingip_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> floatingip after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507407 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> floatingip precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507610 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_floatingip_create_update_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> floatingip precommit_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507610 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_floatingip_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> floatingip after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507610 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_floatingip_status_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> floatingip after_status_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507610 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_floatingip_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> floatingip after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_portforwarding_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> port_forwarding after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_remove_router_interface of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> router_interface after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_router_create of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> router after_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.507953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_router_create_precommit of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> router precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.508167 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_router_delete of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> router after_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.508167 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OvnDriver._process_router_update of <neutron.services.ovn_l3.service_providers.ovn.OvnDriver object at 0x771e3812b6e0>> router after_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.508167 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.services.service_base [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver' provider for service L3_ROUTER_NAT {{(pid=103710) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}}
Mar 19 18:09:17.508167 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method OVNL3RouterPlugin._post_fork_initialize of <neutron.services.ovn_l3.plugin.OVNL3RouterPlugin object at 0x771e37a42ed0>> process after_init 55550001, True {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.508299 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding using OVN {{(pid=103710) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Mar 19 18:09:17.508408 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading Plugin: auto_allocate
Mar 19 18:09:17.509163 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x771e38181440> network precommit_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.509163 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <function _ensure_external_network_default_value_callback at 0x771e38181440> network precommit_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.509539 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=103710) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Mar 19 18:09:17.509539 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading Plugin: tag
Mar 19 18:09:17.512105 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=103710) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Mar 19 18:09:17.512105 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading Plugin: timestamp
Mar 19 18:09:17.513772 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=103710) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Mar 19 18:09:17.513772 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading Plugin: network_ip_availability
Mar 19 18:09:17.514474 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x771e3812ba40>> rbac-policy before_create 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.514474 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x771e3812ba40>> rbac-policy before_update 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.514474 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron_lib.callbacks.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Subscribe: <bound method NeutronDbPluginV2.validate_network_rbac_policy_change of <neutron.services.network_ip_availability.plugin.NetworkIPAvailabilityPlugin object at 0x771e3812ba40>> rbac-policy before_delete 55550000, False {{(pid=103710) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.514990 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=103710) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Mar 19 18:09:17.514990 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading Plugin: flavors
Mar 19 18:09:17.515641 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=103710) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Mar 19 18:09:17.515641 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading Plugin: revisions
Mar 19 18:09:17.517531 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.manager [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=103710) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}}
Mar 19 18:09:17.517531 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_concurrency.lockutils [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 4.133s {{(pid=103710) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Mar 19 18:09:17.517531 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] get_extension_paths = OrderedDict({'/opt/stack/neutron/neutron/extensions': 1}) {{(pid=103710) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}}
Mar 19 18:09:17.517531 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Initializing extension manager.
Mar 19 18:09:17.517531 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: __init__.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.517531 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: __pycache__ {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.517531 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: address_group.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.519406 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.519406 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: address-group
Mar 19 18:09:17.519406 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: address_scope.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.519406 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.519406 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: address-scope
Mar 19 18:09:17.519406 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: admin_state_down_before_update.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.519406 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.519903 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension router-admin-state-down-before-update not supported by any of loaded plugins
Mar 19 18:09:17.519903 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: agent.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.519903 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.519903 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: agent
Mar 19 18:09:17.519903 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: agent_resources_synced.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.519903 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.519903 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension agent-resources-synced not supported by any of loaded plugins
Mar 19 18:09:17.520340 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: allowedaddresspairs.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.520598 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.521193 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: allowed-address-pairs
Mar 19 18:09:17.521193 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: auto_allocated_topology.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.521193 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.521738 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: auto-allocated-topology
Mar 19 18:09:17.521738 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: availability_zone.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.522045 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.522045 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: availability_zone
Mar 19 18:09:17.522231 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: availability_zone_filter.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.522398 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.522591 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension availability_zone_filter not supported by any of loaded plugins
Mar 19 18:09:17.522591 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: data_plane_status.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.522949 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.522949 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension data-plane-status not supported by any of loaded plugins
Mar 19 18:09:17.523057 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: default_subnetpools.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.523305 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.523305 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: default-subnetpools
Mar 19 18:09:17.523478 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: dhcpagentscheduler.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.523661 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.523803 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: dhcp_agent_scheduler
Mar 19 18:09:17.524043 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: dns.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.524254 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.524254 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: dns-integration
Mar 19 18:09:17.524600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: dns_domain_ports.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.524600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.524600 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: dns-domain-ports
Mar 19 18:09:17.524859 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.524859 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like <project_id>, <project_name>, <user_id> and <user_name> as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.525288 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: dns-integration-domain-keywords
Mar 19 18:09:17.525288 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: dvr.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.525288 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.525519 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension dvr not supported by any of loaded plugins
Mar 19 18:09:17.525519 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: ecmp_routes.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.525829 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.525829 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension ecmp_routes not supported by any of loaded plugins
Mar 19 18:09:17.525829 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: empty_string_filtering.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.526103 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.526341 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: empty-string-filtering
Mar 19 18:09:17.526341 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.526466 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.526543 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins
Mar 19 18:09:17.526655 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.526796 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.526967 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins
Mar 19 18:09:17.527047 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: external_net.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.527212 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.527338 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: external-net
Mar 19 18:09:17.527403 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: extra_dhcp_opt.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.527583 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.527716 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: extra_dhcp_opt
Mar 19 18:09:17.527780 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: extraroute.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.527982 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.528113 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: extraroute
Mar 19 18:09:17.528191 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: extraroute_atomic.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.528376 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.528554 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: extraroute-atomic
Mar 19 18:09:17.528554 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: filter_validation.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.528764 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.528982 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: filter-validation
Mar 19 18:09:17.528982 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: fip_pf_description.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.529154 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.529453 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins
Mar 19 18:09:17.529453 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: fip_pf_detail.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.529727 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Floating IP port forwarding detail" alias="floating-ip-port-forwarding-detail" description="Allow list floating ip return more port forwarding data, include'id' and 'internal_port_id'" updated="2022-05-06T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.529817 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: floating-ip-port-forwarding-detail
Mar 19 18:09:17.529817 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: fip_pf_port_range.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.530029 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add support to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.530146 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins
Mar 19 18:09:17.530242 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: fip_port_details.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.530638 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.531118 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: fip-port-details
Mar 19 18:09:17.531118 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: flavors.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.531118 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.531118 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: flavors
Mar 19 18:09:17.531424 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.531424 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.531646 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins
Mar 19 18:09:17.531646 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: floatingip_pools.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.532376 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.532376 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: floatingip-pools
Mar 19 18:09:17.532376 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: ip_allocation.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.532376 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.532376 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension ip_allocation not supported by any of loaded plugins
Mar 19 18:09:17.533566 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.533566 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.533566 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension ip-substring-filtering not supported by any of loaded plugins
Mar 19 18:09:17.533566 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l2_adjacency.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.533566 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.533566 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension l2_adjacency not supported by any of loaded plugins
Mar 19 18:09:17.533566 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.534353 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.534353 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: router
Mar 19 18:09:17.534353 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_conntrack_helper.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.534353 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.535100 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension l3-conntrack-helper not supported by any of loaded plugins
Mar 19 18:09:17.535100 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_enable_default_route_bfd.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.535100 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Enable Default Route BFD" alias="enable-default-route-bfd" description="Enables configurable BFD behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.535100 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: enable-default-route-bfd
Mar 19 18:09:17.535100 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_enable_default_route_ecmp.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.535564 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Enable Default Route ECMP" alias="enable-default-route-ecmp" description="Enables configurable ECMP behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.535564 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: enable-default-route-ecmp
Mar 19 18:09:17.535564 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.535564 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.535858 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: ext-gw-mode
Mar 19 18:09:17.535858 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.536040 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.536040 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: l3-ha
Mar 19 18:09:17.536152 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.536603 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.536603 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins
Mar 19 18:09:17.536603 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_extra_gws.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.536953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron L3 External Gateway Multihoming" alias="external-gateway-multihoming" description="Allow multiple external gateway ports per router" updated="2023-01-18T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.536953 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: external-gateway-multihoming
Mar 19 18:09:17.536953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_flavors.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.537170 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.537170 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: l3-flavors
Mar 19 18:09:17.537410 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_ndp_proxy.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.537610 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.537716 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension l3-ndp-proxy not supported by any of loaded plugins
Mar 19 18:09:17.537776 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.538037 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.538261 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension l3-port-ip-change-not-allowed not supported by any of loaded plugins
Mar 19 18:09:17.538261 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: l3agentscheduler.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.538843 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.538843 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension l3_agent_scheduler not supported by any of loaded plugins
Mar 19 18:09:17.538843 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: local_ip.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.539241 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.539241 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension local_ip not supported by any of loaded plugins
Mar 19 18:09:17.539316 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: logging.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.539563 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.539697 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension logging not supported by any of loaded plugins
Mar 19 18:09:17.539778 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: metering.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.541240 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.541459 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension metering not supported by any of loaded plugins
Mar 19 18:09:17.541459 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.541765 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.541976 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension metering_source_and_destination_fields not supported by any of loaded plugins
Mar 19 18:09:17.541976 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: multiprovidernet.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.542281 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.542281 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: multi-provider
Mar 19 18:09:17.542281 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: netmtu.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.542645 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.542645 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: net-mtu
Mar 19 18:09:17.542854 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: netmtu_writable.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.542854 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.543128 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: net-mtu-writable
Mar 19 18:09:17.543128 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: network_availability_zone.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.543500 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.543500 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: network_availability_zone
Mar 19 18:09:17.543500 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: network_ha.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.543756 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Network HA creation flag" alias="network_ha" description="Network high availability creation flag." updated="2023-04-27T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.543835 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension network_ha not supported by any of loaded plugins
Mar 19 18:09:17.543835 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: network_ip_availability.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.544207 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.544207 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: network-ip-availability
Mar 19 18:09:17.544280 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: network_ip_availability_details.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.544488 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Network IP Availability Details Extension" alias="network-ip-availability-details" description="Add ip_availability_details attribute to network-ip-availabilities resource." updated="2025-10-31T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.544735 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: network-ip-availability-details
Mar 19 18:09:17.544735 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: network_segment_range.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.545043 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.545043 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension network-segment-range not supported by any of loaded plugins
Mar 19 18:09:17.545520 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: pagination.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.545520 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.545520 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: pagination
Mar 19 18:09:17.545520 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_device_profile.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.545928 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.545928 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: port-device-profile
Mar 19 18:09:17.545928 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_hardware_offload_type.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.546249 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port hardware offload" alias="port-hardware-offload-type" description="Expose port hardware offload extension" updated="2023-05-09T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.546249 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension port-hardware-offload-type not supported by any of loaded plugins
Mar 19 18:09:17.546435 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_hint_ovs_tx_steering.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.546564 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port hint: Open vSwitch Tx steering" alias="port-hint-ovs-tx-steering" description="Enable Port hint: Open vSwitch Tx steering" updated="2023-01-01T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.546704 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension port-hint-ovs-tx-steering not supported by any of loaded plugins
Mar 19 18:09:17.546704 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_hints.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.546894 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port hints" alias="port-hints" description="Backend specific port hints to allow backend specific tuning" updated="2023-01-01T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.546993 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension port-hints not supported by any of loaded plugins
Mar 19 18:09:17.547069 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_mac_address_override.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.547408 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Port MAC address override" alias="port-mac-override" description="Allow overriding the MAC address of a direct-physical Port via the active binding profile" updated="2022-03-18T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.547408 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension port-mac-override not supported by any of loaded plugins
Mar 19 18:09:17.547408 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.547793 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.547793 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: port-mac-address-regenerate
Mar 19 18:09:17.547793 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.548091 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.548091 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: port-numa-affinity-policy
Mar 19 18:09:17.548250 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_numa_affinity_policy_socket.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.548430 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port NUMA affinity policy "socket"" alias="port-numa-affinity-policy-socket" description="Adds "socket" to the supported port NUMA affinity policies" updated="2024-02-09T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.548507 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: port-numa-affinity-policy-socket
Mar 19 18:09:17.548543 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_resource_request.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.548747 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.548862 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension port-resource-request not supported by any of loaded plugins
Mar 19 18:09:17.548931 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_resource_request_groups.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.549102 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.549269 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension port-resource-request-groups not supported by any of loaded plugins
Mar 19 18:09:17.549308 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: port_trusted_vif.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.549527 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port trusted vif" alias="port-trusted-vif" description="Expose port 'trusted' attribute in the API" updated="2024-07-10T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.549712 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension port-trusted-vif not supported by any of loaded plugins
Mar 19 18:09:17.549712 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: portbindings.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.550090 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.550090 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: binding
Mar 19 18:09:17.550332 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: portbindings_extended.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.550332 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.550728 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: binding-extended
Mar 19 18:09:17.550728 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: portsecurity.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.550728 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.551151 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: port-security
Mar 19 18:09:17.551151 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: project_id.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.551151 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.551151 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: project-id
Mar 19 18:09:17.551702 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: providernet.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.551702 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.551702 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: provider
Mar 19 18:09:17.551702 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qinq.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.552278 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="QinQ networks" alias="qinq" description="Expose network 'qinq' attribute in the API. This allows to configure network to allow vlan in vlan configuration using 0x8a88 ethertype (QinQ)." updated="2024-12-02T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.552278 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: qinq
Mar 19 18:09:17.552278 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.553071 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.553071 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos not supported by any of loaded plugins
Mar 19 18:09:17.553071 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.553754 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.553754 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins
Mar 19 18:09:17.553754 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.553754 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.553754 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins
Mar 19 18:09:17.555016 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_default.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.555016 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.555016 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-default not supported by any of loaded plugins
Mar 19 18:09:17.555016 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_fip.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.555016 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.555016 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-fip not supported by any of loaded plugins
Mar 19 18:09:17.555016 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_fip_network_policy.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.555842 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.555842 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-fip-network-policy not supported by any of loaded plugins
Mar 19 18:09:17.555842 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_gateway_ip.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.555842 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.555842 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-gateway-ip not supported by any of loaded plugins
Mar 19 18:09:17.555842 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_port_network_policy.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.555842 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.556598 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-port-network-policy not supported by any of loaded plugins
Mar 19 18:09:17.556598 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.556598 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.556598 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-pps-minimum not supported by any of loaded plugins
Mar 19 18:09:17.556598 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.556598 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.556598 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins
Mar 19 18:09:17.557224 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_pps_rule.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.557224 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.557224 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-pps not supported by any of loaded plugins
Mar 19 18:09:17.557224 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_rule_type_details.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.557224 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.557224 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-rule-type-details not supported by any of loaded plugins
Mar 19 18:09:17.557892 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_rule_type_filter.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.557892 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.557892 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-rule-type-filter not supported by any of loaded plugins
Mar 19 18:09:17.557892 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: qos_rules_alias.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.558545 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.558545 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension qos-rules-alias not supported by any of loaded plugins
Mar 19 18:09:17.558545 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: quota_check_limit.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.558545 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.558545 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: quota-check-limit
Mar 19 18:09:17.558545 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: quota_check_limit_default.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.559208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Quota engine limit check by default" alias="quota-check-limit-default" description="By default, the Neutron quota engine checks the resource usage before applying a new quota limit" updated="2024-08-21T16:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.559208 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: quota-check-limit-default
Mar 19 18:09:17.559208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: quotasv2.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.559971 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.559971 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: quotas
Mar 19 18:09:17.559971 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: quotasv2_detail.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.559971 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.559971 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: quota_details
Mar 19 18:09:17.560522 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: rbac.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.560522 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.560776 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: rbac-policies
Mar 19 18:09:17.560776 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: rbac_address_group.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.561071 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.561071 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension rbac-address-group not supported by any of loaded plugins
Mar 19 18:09:17.561071 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: rbac_address_scope.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.561427 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.561427 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: rbac-address-scope
Mar 19 18:09:17.561648 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: rbac_security_groups.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.561766 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.561902 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: rbac-security-groups
Mar 19 18:09:17.561902 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: rbac_subnetpool.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.562182 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.562263 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension rbac-subnetpool not supported by any of loaded plugins
Mar 19 18:09:17.562263 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: revisionifmatch.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.562479 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.562608 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: revision-if-match
Mar 19 18:09:17.562643 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: revisions.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.562838 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.563021 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: standard-attr-revisions
Mar 19 18:09:17.563057 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: router_availability_zone.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.563342 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.563378 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: router_availability_zone
Mar 19 18:09:17.563452 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: router_enable_snat.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.563663 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Exposes the router "enable_snat" read-only configuration flag" alias="router-enable-snat" description="Exposes the router "enable_snat" read-only configuration flag" updated="2025-09-18T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.563821 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: router-enable-snat
Mar 19 18:09:17.563821 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: routerservicetype.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.564084 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.564257 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension router-service-type not supported by any of loaded plugins
Mar 19 18:09:17.564257 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: security_groups_default_rules.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.564582 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Default rules for security groups" alias="security-groups-default-rules" description="Configure set of security group rules used as default rules for every new security group" updated="2022-12-19T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.564756 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: security-groups-default-rules
Mar 19 18:09:17.564756 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.564980 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.565111 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: security-groups-normalized-cidr
Mar 19 18:09:17.565183 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: security_groups_port_filtering.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.565358 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.565572 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension port-security-groups-filtering not supported by any of loaded plugins
Mar 19 18:09:17.565572 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.565779 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.566064 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: security-groups-remote-address-group
Mar 19 18:09:17.566064 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: security_groups_rules_belongs_to_default_sg.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.566434 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Security group rule belongs to the project's default security group" alias="security-groups-rules-belongs-to-default-sg" description="Flag to determine if the security group rule belongs to the project's default security group" updated="2023-05-23T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.566434 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: security-groups-rules-belongs-to-default-sg
Mar 19 18:09:17.566434 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.566970 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.566970 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: security-groups-shared-filtering
Mar 19 18:09:17.566970 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: securitygroup.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.568164 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.568369 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: security-group
Mar 19 18:09:17.568369 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: segment.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.568670 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.568937 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension segment not supported by any of loaded plugins
Mar 19 18:09:17.568937 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.569354 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.569354 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins
Mar 19 18:09:17.569354 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: servicetype.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.569995 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.569995 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: service-type
Mar 19 18:09:17.569995 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: sorting.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.569995 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.569995 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: sorting
Mar 19 18:09:17.570811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: standard_attr_segment.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.570811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.570811 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension standard-attr-segment not supported by any of loaded plugins
Mar 19 18:09:17.570811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: standardattrdescription.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.570811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.570811 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: standard-attr-description
Mar 19 18:09:17.571932 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: stateful_security_group.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.571932 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.571932 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: stateful-security-group
Mar 19 18:09:17.571932 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: stdattrs_common.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.571932 np0000160124 neutron-ovn-maintenance-worker[103710]: WARNING neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py
Mar 19 18:09:17.571932 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.571932 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.572844 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: subnet-dns-publish-fixed-ip
Mar 19 18:09:17.572844 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: subnet_external_network.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.572844 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Subnet belongs to an external network" alias="subnet-external-network" description="Informs if the subnet belongs to an external network" updated="2024-02-05T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.572844 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: subnet-external-network
Mar 19 18:09:17.572844 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: subnet_onboard.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.572844 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.572844 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension subnet_onboard not supported by any of loaded plugins
Mar 19 18:09:17.574157 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.574157 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.574157 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins
Mar 19 18:09:17.574157 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: subnet_service_types.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.574157 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.574157 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: subnet-service-types
Mar 19 18:09:17.574157 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: subnetallocation.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.575090 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.575090 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: subnet_allocation
Mar 19 18:09:17.575090 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.575090 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.575090 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: subnetpool-prefix-ops
Mar 19 18:09:17.575090 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: tag_creation.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.575090 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Tag creation extension" alias="tag-creation" description="Allow to create multiple tags for a resource" updated="2024-23-07T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.576079 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: tag-creation
Mar 19 18:09:17.576079 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.576079 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.576079 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins
Mar 19 18:09:17.576079 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: tagging.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.576079 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.576079 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: standard-attr-tag
Mar 19 18:09:17.576954 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: timestamp.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.576954 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.576954 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: standard-attr-timestamp
Mar 19 18:09:17.576954 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: trunk.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.576954 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.576954 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension trunk not supported by any of loaded plugins
Mar 19 18:09:17.576954 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: trunk_details.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.577743 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.577743 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension trunk-details not supported by any of loaded plugins
Mar 19 18:09:17.577743 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: uplink_status_propagation.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.577743 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.577743 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension uplink-status-propagation not supported by any of loaded plugins
Mar 19 18:09:17.577743 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: uplink_status_propagation_updatable.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.578417 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Uplink status propagation updatable extension" alias="uplink-status-propagation-updatable" description="Provides ability to update the port uplink status." updated="2024-09-03T18:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.578417 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Extension uplink-status-propagation-updatable not supported by any of loaded plugins
Mar 19 18:09:17.578417 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loading extension file: vlantransparent.py {{(pid=103710) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}}
Mar 19 18:09:17.578417 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=103710) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}}
Mar 19 18:09:17.579046 np0000160124 neutron-ovn-maintenance-worker[103710]: INFO neutron.api.extensions [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Loaded extension: vlan-transparent
Mar 19 18:09:17.581127 np0000160124 neutron-ovn-maintenance-worker[103710]: WARNING oslo_service.backend._threading.service [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Service MaintenanceWorker is not picklable with spawn; falling back to fork. Please make the service spawn-safe to avoid this fallback.
Mar 19 18:09:17.581127 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Full set of CONF: {{(pid=103710) _load_service_manager_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:59}}
Mar 19 18:09:17.581559 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ******************************************************************************** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Mar 19 18:09:17.581559 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Configuration options gathered from: {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Mar 19 18:09:17.581559 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Mar 19 18:09:17.581559 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Mar 19 18:09:17.581559 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ================================================================================ {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Mar 19 18:09:17.581559 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] agent_down_time                = 75 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582349 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] allow_automatic_dhcp_failover  = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582349 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] allow_bulk                     = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582349 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582349 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] api_extensions_path            =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582349 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] api_paste_config               = api-paste.ini {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582349 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] api_workers                    = 4 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582975 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] auth_strategy                  = keystone {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582975 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] backlog                        = 4096 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582975 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] base_mac                       = fa:16:3e:00:00:00 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582975 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] bind_host                      = 0.0.0.0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582975 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] bind_port                      = 9696 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582975 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] client_socket_timeout          = 900 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.582975 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] config_dir                     = [] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.583723 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.583723 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] config_source                  = [] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.583723 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] control_exchange               = neutron {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.583723 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] core_plugin                    = ml2 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.583723 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] debug                          = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.583723 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] default_availability_zones     = [] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.584360 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.584360 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] dhcp_agent_notification        = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.584360 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] dhcp_agents_per_network        = 1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.584360 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] dhcp_lease_duration            = 86400 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.584360 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] dhcp_load_type                 = networks {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.585208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] dns_domain                     = openstacklocal {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.585208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.585208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] enable_default_route_bfd       = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.585208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] enable_default_route_ecmp      = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.585208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] enable_dvr                     = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.585208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] enable_new_agents              = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.585208 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586010 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] enable_snat_by_default         = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586010 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] enable_traditional_dhcp        = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586010 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] external_dns_driver            = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586010 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] filter_validation              = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586010 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] global_physnet_mtu             = 1430 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586010 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] graceful_shutdown_timeout      = 60 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586010 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] host                           = np0000160124 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586696 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] host_dvr_for_dhcp              = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586696 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] http_retries                   = 3 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586696 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] instance_format                = [instance: %(uuid)s]  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586696 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586696 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ipam_driver                    = internal {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586696 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ipv6_pd_enabled                = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.586696 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] l3_ha                          = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.587422 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.587422 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] l3_ha_network_physical_name    =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.587422 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] l3_ha_network_type             =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.587422 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_color                      = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.587422 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_config_append              = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.587422 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.587422 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_dir                        = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588172 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_file                       = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588172 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_options                    = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588172 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_rotate_interval            = 1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588172 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_rotate_interval_type       = days {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588172 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] log_rotation_type              = none {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588172 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] max_allowed_address_pair       = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.588811 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] max_dns_nameservers            = 5 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] max_header_line                = 16384 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] max_l3_agents_per_router       = 3 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] max_logfile_count              = 30 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] max_logfile_size_mb            = 200 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] max_routes                     = 30 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] max_subnet_host_routes         = 20 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589295 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] my_ip                          = 199.19.213.59 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589846 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] my_ipv6                        = 2604:e100:1:0:f816:3eff:fea1:292b {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589846 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] network_auto_schedule          = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589846 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] network_link_prefix            = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589846 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589846 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] notify_nova_on_port_data_changes = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589846 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] notify_nova_on_port_status_changes = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.589846 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] pagination_max_limit           = -1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.590571 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] periodic_fuzzy_delay           = 5 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.590571 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] periodic_interval              = 40 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.590571 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] publish_errors                 = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.590571 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] rate_limit_burst               = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.590571 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] rate_limit_except_level        = CRITICAL {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.590571 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] rate_limit_interval            = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.590571 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] retry_until_window             = 30 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591096 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] router_distributed             = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591096 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] rpc_resources_processing_step  = 20 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591096 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] rpc_response_max_timeout       = 600 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591096 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] rpc_response_timeout           = 60 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591096 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] rpc_state_report_workers       = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591096 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] rpc_workers                    = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591096 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] send_events_interval           = 2 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591595 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] service_plugins                = ['ovn-router'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591595 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] setproctitle                   = on {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591595 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] shell_completion               = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591595 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] state_path                     = /opt/stack/data/neutron {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591595 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] syslog_log_facility            = LOG_USER {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591595 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] tcp_keepidle                   = 600 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.591595 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] transport_url                  = **** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.592652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] use_journal                    = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.592652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] use_json                       = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.592652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] use_ssl                        = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.592652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] use_stderr                     = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.592652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] use_syslog                     = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.592652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] vlan_qinq                      = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.592652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] vlan_transparent               = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.593333 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] wsgi_default_pool_size         = 100 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.593333 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] wsgi_keep_alive                = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.593333 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.593333 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] wsgi_server_debug              = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.593333 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_concurrency.disable_process_locking = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.593333 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.594590 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.connection_string     = messaging:// {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.594590 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.enabled               = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.594590 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.es_doc_type           = notification {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.594590 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.es_scroll_size        = 10000 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.594590 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.es_scroll_time        = 2m {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.594590 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.filter_error_trace    = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.594590 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.hmac_keys             = **** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595400 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.sentinel_service_name = mymaster {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595400 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.socket_timeout        = 0.1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595400 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.trace_requests        = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595400 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler.trace_sqlalchemy      = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595400 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler_jaeger.process_tags   = {} {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595400 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler_jaeger.service_name_prefix = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595400 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] profiler_otlp.service_name_prefix = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595959 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595959 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595959 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595959 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595959 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.595959 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.enforce_new_defaults = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596471 np0000160124 neutron-ovn-maintenance-worker[103710]: WARNING oslo_config.cfg [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Mar 19 18:09:17.596471 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.enforce_scope      = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596471 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.policy_default_rule = default {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596471 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596471 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596471 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596921 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596921 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596921 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596921 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596921 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596921 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.596921 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] service_providers.service_provider = [] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597484 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.auth_section              = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597484 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.auth_type                 = password {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597484 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.auth_url                  = https://199.19.213.59/identity {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597484 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.cafile                    = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597484 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.certfile                  = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597484 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.collect_timing            = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597484 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.default_domain_id         = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597973 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.default_domain_name       = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597973 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.domain_id                 = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597973 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.domain_name               = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597973 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.endpoint_type             = public {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597973 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.insecure                  = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597973 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.keyfile                   = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.597973 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.password                  = **** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.598600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.project_domain_id         = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.598600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.project_domain_name       = Default {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.598600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.project_id                = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.598600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.project_name              = service {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.598600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.region_name               = RegionOne {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.598600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.split_loggers             = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.598600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.system_scope              = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599086 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.timeout                   = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599086 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.trust_id                  = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599086 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.user_domain_id            = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599086 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.user_domain_name          = Default {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599086 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.user_id                   = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599086 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] nova.username                  = nova {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599086 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.auth_section         = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599572 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.auth_type            = password {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599572 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.cafile               = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599572 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.certfile             = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599572 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.collect_timing       = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599572 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.endpoint_type        = public {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599572 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.insecure             = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.599572 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.keyfile              = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600008 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.region_name          = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600008 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.split_loggers        = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600008 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] placement.timeout              = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600008 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.auth_section            = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600008 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.auth_type               = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600008 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.cafile                  = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600008 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.certfile                = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600363 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.collect_timing          = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600363 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.connect_retries         = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600363 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.connect_retry_delay     = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600363 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.enable_notifications    = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600363 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.endpoint_override       = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600363 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.insecure                = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600363 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.interface               = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600747 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.keyfile                 = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600747 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.max_version             = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600747 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.min_version             = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600747 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.region_name             = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600747 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.retriable_status_codes  = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600747 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.service_name            = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.600747 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.service_type            = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601135 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.split_loggers           = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601135 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.status_code_retries     = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601135 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.status_code_retry_delay = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601135 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.timeout                 = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601135 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.valid_interfaces        = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601135 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ironic.version                 = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601135 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] cli_script.dry_run             = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601664 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601664 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601664 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601664 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601664 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601664 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.601664 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602080 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602080 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602080 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.hostname = np0000160124 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602080 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602080 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602080 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602080 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602643 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602643 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602643 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602643 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602643 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602643 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.602643 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603183 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603183 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603183 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603183 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603183 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603183 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603183 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603751 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603751 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603751 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.ssl      = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603751 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603751 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603751 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.603751 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604416 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604416 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604416 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_notifications.driver = [] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604416 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_notifications.retry = -1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604416 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604416 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_messaging_notifications.transport_url = **** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604416 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_reports.file_event_handler = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_reports.log_dir           = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.default_quota           = -1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_floatingip        = 50 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.604953 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_network           = 100 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.605542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_port              = 500 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.605542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_rbac_policy       = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.605542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_router            = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.605542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_security_group    = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.605542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.605542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.quota_subnet            = 100 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.605542 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] QUOTAS.track_quota_usage       = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606103 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606103 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep.group                  = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606103 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep.helper_command         = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606103 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep.log_daemon_traceback   = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606103 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep.logger_name            = oslo_privsep.daemon {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606103 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep.thread_pool_size       = 16 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606103 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep.user                   = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606623 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606623 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_dhcp_release.group     = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606623 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_dhcp_release.helper_command = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606623 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606623 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606623 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_dhcp_release.thread_pool_size = 16 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.606623 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_dhcp_release.user      = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607209 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607209 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_ovs_vsctl.group        = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607209 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_ovs_vsctl.helper_command = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607209 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607209 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607209 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607209 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_ovs_vsctl.user         = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607777 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_namespace.capabilities = [21] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607777 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_namespace.group        = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607777 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_namespace.helper_command = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607777 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_namespace.log_daemon_traceback = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607777 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607777 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_namespace.thread_pool_size = 16 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.607777 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_namespace.user         = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608314 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_conntrack.capabilities = [12] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608314 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_conntrack.group        = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608314 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_conntrack.helper_command = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608314 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608314 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608314 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_conntrack.thread_pool_size = 16 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608314 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_conntrack.user         = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608853 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_link.capabilities      = [12, 21] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608853 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_link.group             = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608853 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_link.helper_command    = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608853 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_link.log_daemon_traceback = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608853 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608853 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_link.thread_pool_size  = 16 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.608853 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] privsep_link.user              = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609357 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609357 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609357 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] AGENT.use_helper_for_ns_read   = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609357 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] SECURITYGROUP.enable_ipset     = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609357 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] SECURITYGROUP.enable_security_group = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609357 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] SECURITYGROUP.firewall_driver  = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609821 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609821 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] experimental.ipv6_pd_enabled   = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609821 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609821 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.external_network_type      = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609821 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.mechanism_drivers          = ['ovn'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609821 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.overlay_ip_version         = 4 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.609821 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.path_mtu                   = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.610394 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.physical_network_mtus      = {} {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.610394 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.project_network_types      = ['geneve'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.610394 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.610394 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.610394 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2_type_flat.flat_networks    = ['public'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.610394 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2_type_geneve.max_header_size = 38 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.610394 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611049 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611049 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] network_log.burst_limit        = 25 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611049 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] network_log.local_output_log_base = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611049 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] network_log.rate_limit         = 100 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611049 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.asyncio_connection    = **** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611049 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.asyncio_slave_connection = **** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611049 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.backend               = sqlalchemy {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611433 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.connection            = **** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611433 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.connection_debug      = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611433 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.connection_parameters =  {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611433 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.connection_recycle_time = 3600 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611433 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.connection_trace      = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611433 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.db_inc_retry_interval = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611433 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.db_max_retries        = 20 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611750 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.db_max_retry_interval = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611750 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.db_retry_interval     = 1 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611750 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.max_overflow          = 50 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611750 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.max_pool_size         = 5 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611750 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.max_retries           = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611750 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.611750 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.mysql_wsrep_sync_wait = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612256 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.pool_timeout          = None {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612256 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.retry_interval        = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612256 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.slave_connection      = **** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612256 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.sqlite_synchronous    = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612256 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.synchronous_reader    = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612256 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] database.use_db_reconnect      = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612256 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.bfd_min_rx                 = 1000 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.bfd_min_tx                 = 100 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.bfd_mult                   = 3 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.broadcast_arps_to_all_routers = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612652 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.dhcp_default_lease_time    = 43200 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612955 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612955 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.dns_records_ovn_owned      = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612955 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.dns_servers                = [] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.612955 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.enable_distributed_floating_ip = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613181 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.fdb_age_threshold          = 300 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613181 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ha_failover_strategy       = normal {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613333 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.live_migration_activation_strategy = rarp {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613333 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.localnet_learn_fdb         = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613564 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.mac_binding_age_threshold  = 300 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613564 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.neutron_sync_mode          = log {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613564 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_dhcp4_global_options   = {} {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613723 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_dhcp6_global_options   = {} {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613723 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_l3_scheduler           = leastloaded {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613908 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_metadata_enabled       = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.613908 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.614239 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.614239 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_nb_connection          = ['ssl:199.19.213.59:6641'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.614239 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.614239 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_router_indirect_snat   = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.614600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.614600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.614600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_sb_connection          = ['ssl:199.19.213.59:6642'] {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.614600 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615004 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovs_create_tap             = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615004 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovsdb_connection_timeout   = 180 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615004 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovsdb_log_level            = INFO {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615004 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovsdb_probe_interval       = 60000 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615004 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.ovsdb_retry_max_interval   = 180 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615456 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.stateless_nat_enabled      = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615456 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615456 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] OVS.bridge_mac_table_size      = 50000 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.615456 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] OVS.igmp_flood                 = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.616034 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] OVS.igmp_flood_reports         = True {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.616034 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] OVS.igmp_flood_unregistered    = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.616034 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] OVS.igmp_snooping_enable       = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.616034 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] OVS.ovsdb_timeout              = 10 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.616034 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn_nb_global.fdb_removal_limit = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.616034 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn_nb_global.ignore_lsp_down  = False {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.616034 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.616634 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG cotyledon.oslo_config_glue [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] ******************************************************************************** {{(pid=103710) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Mar 19 18:09:17.616634 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG oslo_service.backend._threading.service [None req-3e838c18-8b19-4cca-854a-d8b524fedb42 None None] Selected the multiprocessing context: <multiprocessing.context.ForkContext object at 0x771e3d8d8a40> and updated it in Cotyledon ServiceManager: <multiprocessing.context.ForkContext object at 0x771e3d8d8a40> {{(pid=103710) launch_service /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/service.py:394}}
Mar 19 18:09:17.645088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] Full set of CONF: {{(pid=103900) _load_service_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:65}}
Mar 19 18:09:17.645768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}}
Mar 19 18:09:17.645768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] Configuration options gathered from: {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}}
Mar 19 18:09:17.645768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}}
Mar 19 18:09:17.645768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}}
Mar 19 18:09:17.645768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ================================================================================ {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}}
Mar 19 18:09:17.645768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] agent_down_time                = 75 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.646574 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] allow_automatic_dhcp_failover  = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.646574 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] allow_bulk                     = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.646574 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] allowed_conntrack_helpers      = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.646574 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] api_extensions_path            =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.646574 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] api_paste_config               = api-paste.ini {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.646951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] api_workers                    = 4 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.646951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] auth_strategy                  = keystone {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.646951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] backlog                        = 4096 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.647251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] base_mac                       = fa:16:3e:00:00:00 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.647415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] bind_host                      = 0.0.0.0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.647415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] bind_port                      = 9696 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.647616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] client_socket_timeout          = 900 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.647747 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] config_dir                     = [] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.647869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] config_file                    = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.648009 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] config_source                  = [] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.648227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] control_exchange               = neutron {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.648328 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] core_plugin                    = ml2 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.648462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] debug                          = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.648584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] default_availability_zones     = [] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.648784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.648952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agent_notification        = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.649171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agents_per_network        = 1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.649171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] dhcp_lease_duration            = 86400 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.649355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] dhcp_load_type                 = networks {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.649355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] dns_domain                     = openstacklocal {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.649627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] dvr_base_mac                   = fa:16:3f:00:00:00 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.649627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_bfd       = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.649772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_ecmp      = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.649856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] enable_dvr                     = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650012 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] enable_new_agents              = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650012 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] enable_services_on_agents_with_admin_state_down = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] enable_snat_by_default         = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] enable_traditional_dhcp        = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] external_dns_driver            = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] fatal_deprecations             = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] filter_validation              = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] global_physnet_mtu             = 1430 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] graceful_shutdown_timeout      = 60 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.650895 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] host                           = np0000160124 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] host_dvr_for_dhcp              = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] http_retries                   = 3 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] instance_format                = [instance: %(uuid)s]  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ipam_driver                    = internal {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ipv6_pd_enabled                = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] l3_ha                          = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_net_cidr                 = 169.254.192.0/18 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_physical_name    =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_type             =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_color                      = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_config_append              = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_dir                        = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.651912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_file                       = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_options                    = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval            = 1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval_type       = days {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] log_rotation_type              = none {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.652553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] max_allowed_address_pair       = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] max_dns_nameservers            = 5 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] max_header_line                = 16384 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] max_l3_agents_per_router       = 3 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_count              = 30 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_size_mb            = 200 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] max_routes                     = 30 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] max_subnet_host_routes         = 20 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] my_ip                          = 199.19.213.59 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] my_ipv6                        = 2604:e100:1:0:f816:3eff:fea1:292b {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] network_auto_schedule          = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] network_link_prefix            = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] network_scheduler_driver       = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_data_changes = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_status_changes = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] pagination_max_limit           = -1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] periodic_fuzzy_delay           = 5 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] periodic_interval              = 40 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] publish_errors                 = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_burst               = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.653932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_except_level        = CRITICAL {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_interval            = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] retry_until_window             = 30 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] router_distributed             = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] rpc_resources_processing_step  = 20 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_max_timeout       = 600 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_timeout           = 60 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] rpc_state_report_workers       = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] rpc_workers                    = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] send_events_interval           = 2 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] service_plugins                = ['ovn-router'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] setproctitle                   = on {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] shell_completion               = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.654861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] state_path                     = /opt/stack/data/neutron {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] syslog_log_facility            = LOG_USER {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] tcp_keepidle                   = 600 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] transport_url                  = **** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] use_journal                    = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] use_json                       = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] use_ssl                        = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] use_stderr                     = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] use_syslog                     = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] vlan_qinq                      = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] vlan_transparent               = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] wsgi_default_pool_size         = 100 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] wsgi_keep_alive                = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] wsgi_log_format                = %(client_ip)s "%(request_line)s" status: %(status_code)s  len: %(body_length)s time: %(wall_seconds).7f {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.655740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] wsgi_server_debug              = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}}
Mar 19 18:09:17.656166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.disable_process_locking = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.lock_path     = /opt/stack/data/neutron/lock {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.connection_string     = messaging:// {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.enabled               = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_doc_type           = notification {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_size        = 10000 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_time        = 2m {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.filter_error_trace    = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.hmac_keys             = **** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.656651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.sentinel_service_name = mymaster {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.socket_timeout        = 0.1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_requests        = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_sqlalchemy      = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.process_tags   = {} {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.service_name_prefix = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] profiler_otlp.service_name_prefix = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_process_name =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.657440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_new_defaults = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_scope      = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_default_rule = default {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_file        = /etc/neutron/policy.json {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658466 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658466 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658466 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_timeout     = 60.0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658466 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] service_providers.service_provider = [] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_section              = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_type                 = password {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_url                  = https://199.19.213.59/identity {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.cafile                    = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.certfile                  = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.658864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.collect_timing            = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_id         = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_name       = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_id                 = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_name               = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.endpoint_type             = public {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.insecure                  = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.keyfile                   = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.password                  = **** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_id         = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_name       = Default {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.project_id                = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.project_name              = service {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.region_name               = RegionOne {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.split_loggers             = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.system_scope              = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.timeout                   = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.trust_id                  = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.659827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_id            = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_name          = Default {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.user_id                   = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] nova.username                  = nova {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_section         = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_type            = password {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.cafile               = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.certfile             = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.collect_timing       = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.endpoint_type        = public {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.insecure             = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.keyfile              = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.region_name          = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.split_loggers        = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] placement.timeout              = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_section            = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_type               = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.cafile                  = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.660853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.certfile                = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.collect_timing          = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retries         = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retry_delay     = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.enable_notifications    = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.endpoint_override       = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.insecure                = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.interface               = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.keyfile                 = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.max_version             = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.min_version             = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.region_name             = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.retriable_status_codes  = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_name            = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_type            = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.split_loggers           = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retries     = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retry_delay = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.timeout                 = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.valid_interfaces        = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ironic.version                 = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] cli_script.dry_run             = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.661851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.hostname = np0000160124 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.662725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl      = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_key_file =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_version =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.driver = [] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.retry = -1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.transport_url = **** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.log_dir           = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.default_quota           = -1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_driver            = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_floatingip        = 50 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_network           = 100 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_port              = 500 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_rbac_policy       = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_router            = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group    = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group_rule = 100 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_subnet            = 100 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.track_quota_usage       = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.663862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep.capabilities           = [21, 12, 1, 2, 19] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep.group                  = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep.helper_command         = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep.log_daemon_traceback   = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep.logger_name            = oslo_privsep.daemon {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep.thread_pool_size       = 16 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep.user                   = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.group     = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.helper_command = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.log_daemon_traceback = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.thread_pool_size = 16 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.user      = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.group        = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.helper_command = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.logger_name  = oslo_privsep.daemon {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.user         = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.capabilities = [21] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.group        = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.helper_command = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.log_daemon_traceback = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.664983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.logger_name  = oslo_privsep.daemon {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.thread_pool_size = 16 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.user         = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.capabilities = [12] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.group        = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.helper_command = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.log_daemon_traceback = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.logger_name  = oslo_privsep.daemon {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.thread_pool_size = 16 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.user         = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.capabilities      = [12, 21] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.group             = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.helper_command    = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.log_daemon_traceback = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.logger_name       = oslo_privsep.daemon {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.thread_pool_size  = 16 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.665764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.user              = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper              = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper_daemon       = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] AGENT.use_helper_for_ns_read   = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_ipset     = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_security_group = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.firewall_driver  = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] experimental.ipv6_pd_enabled   = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.extension_drivers          = ['port_security', 'qos'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.external_network_type      = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.mechanism_drivers          = ['ovn'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.overlay_ip_version         = 4 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.path_mtu                   = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.physical_network_mtus      = {} {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.project_network_types      = ['geneve'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.tunnelled_network_rp_name  = rp_tunnelled {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.666846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2.type_drivers               = ['local', 'flat', 'vlan', 'geneve'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_flat.flat_networks    = ['public'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.max_header_size = 38 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.vni_ranges     = ['1:65536'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] network_log.burst_limit        = 25 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] network_log.local_output_log_base = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] network_log.rate_limit         = 100 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_connection    = **** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_slave_connection = **** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.backend               = sqlalchemy {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.connection            = **** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.connection_debug      = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.connection_parameters =  {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.connection_recycle_time = 3600 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.connection_trace      = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.db_inc_retry_interval = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retries        = 20 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.667905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retry_interval = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.db_retry_interval     = 1 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.max_overflow          = 50 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.max_pool_size         = 5 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.max_retries           = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_sql_mode        = TRADITIONAL {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_wsrep_sync_wait = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.pool_timeout          = None {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.retry_interval        = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.slave_connection      = **** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.sqlite_synchronous    = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.synchronous_reader    = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] database.use_db_reconnect      = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_rx                 = 1000 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_min_tx                 = 100 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.bfd_mult                   = 3 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.broadcast_arps_to_all_routers = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.dhcp_default_lease_time    = 43200 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.668716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_records_ovn_owned      = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_servers                = [] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.enable_distributed_floating_ip = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.fdb_age_threshold          = 300 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ha_failover_strategy       = normal {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.live_migration_activation_strategy = rarp {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.localnet_learn_fdb         = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.mac_binding_age_threshold  = 300 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.neutron_sync_mode          = log {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp4_global_options   = {} {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp6_global_options   = {} {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_l3_scheduler           = leastloaded {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_metadata_enabled       = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_connection          = ['ssl:199.19.213.59:6641'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_router_indirect_snat   = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_ca_cert             = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_certificate         = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_connection          = ['ssl:199.19.213.59:6642'] {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_private_key         = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovs_create_tap             = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_connection_timeout   = 180 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.669982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_log_level            = INFO {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_probe_interval       = 60000 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_retry_max_interval   = 180 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.stateless_nat_enabled      = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn.vhost_sock_dir             = /var/run/openvswitch {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] OVS.bridge_mac_table_size      = 50000 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood                 = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_reports         = True {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_unregistered    = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.670634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_snooping_enable       = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.671130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] OVS.ovsdb_timeout              = 10 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.671130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.671130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.ignore_lsp_down  = False {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.671130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}}
Mar 19 18:09:17.671130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=103900) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}}
Mar 19 18:09:17.671130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG cotyledon._service_worker [-] Run service ServiceWrapper(0) [103900] {{(pid=103900) wait_forever /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/_service_worker.py:218}}
Mar 19 18:09:17.672179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-2068264', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._post_fork_initialize-16454873'] for process (None), after_init {{(pid=103900) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Mar 19 18:09:17.674295 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry
Mar 19 18:09:17.722143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Switch.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Mar 19 18:09:17.722143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Router.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Mar 19 18:09:17.722143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Load_Balancer.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Mar 19 18:09:17.722143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Copp.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Meter.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Load_Balancer_Group.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index HA_Chassis_Group.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Address_Set.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Connection.target {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Gateway_Chassis.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Mirror.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Template_Var.chassis {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Router_Port.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port_Group.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.722780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Switch_Port.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.724820 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.19.213.59:6641: connecting...
Mar 19 18:09:17.730301 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.19.213.59:6641: connected
Mar 19 18:09:17.757765 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbSbOvnIdl for MaintenanceWorker with retry
Mar 19 18:09:17.787710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Mar 19 18:09:17.787786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}}
Mar 19 18:09:17.787836 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.787922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=103900) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Mar 19 18:09:17.790196 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.19.213.59:6642: connecting...
Mar 19 18:09:17.795947 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.19.213.59:6642: connected
Mar 19 18:09:17.852017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x771e38099e20>> floatingip precommit_update 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_floatingip_request of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x771e38099e20>> floatingip precommit_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x771e38099e20>> floatingip before_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._check_port_has_port_forwarding of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x771e38099e20>> floatingip before_update 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x771e38099e20>> port after_update 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method PortForwardingPlugin._process_port_request_handler of <neutron.services.portforwarding.pf_plugin.PortForwardingPlugin object at 0x771e38099e20>> port precommit_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding.register-16455270'] for port_forwarding_plugin (None), after_init {{(pid=103900) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Mar 19 18:09:17.852588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x771e37a43da0>> port_forwarding after_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x771e37a43da0>> router_interface after_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852718 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x771e37a43da0>> port_forwarding after_update 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_notification of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x771e37a43da0>> port_forwarding after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.852860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method OVNPortForwarding._handle_lb_on_ls of <neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding object at 0x771e37a43da0>> router_interface after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.853038 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Mar 19 18:09:17.853148 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [-] Starting OVNClientPlacementExtension
Mar 19 18:09:17.853526 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._prevent_segment_delete_with_subnet_associated of <neutron.services.segments.plugin.Plugin object at 0x771e37a34470>> segment before_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.853605 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method Plugin._validate_auto_address_subnet_delete of <neutron.services.segments.plugin.Plugin object at 0x771e37a34470>> subnet precommit_delete_associations 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.853973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_addition_to_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> segment_host_mapping after_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.854077 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_host_removal_from_aggregate of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> segment_host_mapping after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.854077 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> port after_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.854217 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_created_or_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> port after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.854217 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_port_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> port after_update 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.854338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_segment_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> segment after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.854338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_created of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> subnet after_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.854456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_deleted of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> subnet after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.854456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method NovaSegmentNotifier._notify_subnet_updated of <neutron.services.segments.plugin.NovaSegmentNotifier object at 0x771e37a34440>> subnet after_update 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.913778 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x771e380c1790>> subnet after_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.913932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_after_delete of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x771e380c1790>> subnet after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.913932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_create of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x771e380c1790>> subnet before_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.914009 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SegmentHostRoutes.host_routes_before_update of <neutron.services.segments.plugin.SegmentHostRoutes object at 0x771e380c1790>> subnet before_update 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.916804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_resource_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x771e38069190>> security_group after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.916804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method LoggingPlugin._clean_logs_by_target_id of <neutron.services.logapi.logging_plugin.LoggingPlugin object at 0x771e38069190>> port after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.916804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.logapi.drivers.ovn.driver.DriverBase._register-16016532'] for logging-plugin (None), after_init {{(pid=103900) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Mar 19 18:09:17.916804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x771e3806b710>> security_group_rule after_create 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.916804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x771e3806b710>> security_group_rule after_update 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:17.917070 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: <bound method SecurityGroupRuleCallBack.handle_event of <neutron.services.logapi.common.sg_callback.SecurityGroupRuleCallBack object at 0x771e3806b710>> security_group_rule after_delete 55550000, False {{(pid=103900) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}}
Mar 19 18:09:27.379146 np0000160124 neutron-ovn-maintenance-worker[103710]: DEBUG dbcounter [-] [103710] Writing DB stats neutron:SELECT=7,neutron:INSERT=1 {{(pid=103710) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:09:27.918336 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Northbound DB sync process started @ 2026-03-19 18:09:27.917766 {{(pid=103900) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:98}}
Mar 19 18:09:27.921259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync port groups started @ 2026-03-19 18:09:27.920736 {{(pid=103900) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:131}}
Mar 19 18:09:27.941193 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writer thread running {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Mar 19 18:09:27.963778 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync port groups completed @ 2026-03-19 18:09:27.963430 {{(pid=103900) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:195}}
Mar 19 18:09:27.963866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync networks, ports and DHCP options started @ 2026-03-19 18:09:27.963757 {{(pid=103900) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1124}}
Mar 19 18:09:28.078933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.services.segments.db [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] neutron.services.segments.plugin.Plugin method get_segments called with arguments (<neutron_lib.context.Context object at 0x771e36c66150>,) {'filters': {'network_id': ['3fbbc8ff-d939-4c17-8632-0e651722214d'], 'is_dynamic': False}} {{(pid=103900) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}}
Mar 19 18:09:28.084090 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync metadata ports started {{(pid=103900) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1069}}
Mar 19 18:09:28.135787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync metadata ports completed {{(pid=103900) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1121}}
Mar 19 18:09:28.135930 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync DHCP options for Neutron subnets started {{(pid=103900) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:921}}
Mar 19 18:09:28.150582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync DHCP options for Neutron subnets completed @ 2026-03-19 18:09:28.150355 {{(pid=103900) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:994}}
Mar 19 18:09:28.151711 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Mar 19 18:09:28.153380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned started {{(pid=103900) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:999}}
Mar 19 18:09:28.153380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned completed {{(pid=103900) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1058}}
Mar 19 18:09:28.153380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync networks, ports and DHCP options completed @ 2026-03-19 18:09:28.152421 {{(pid=103900) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1293}}
Mar 19 18:09:28.153380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync ACLs started @ 2026-03-19 18:09:28.152535 {{(pid=103900) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:238}}
Mar 19 18:09:28.199208 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync ACLs completed @ 2026-03-19 18:09:28.198832 {{(pid=103900) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:428}}
Mar 19 18:09:28.199346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync routers and router ports started @ 2026-03-19 18:09:28.199202 {{(pid=103900) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:595}}
Mar 19 18:09:28.657660 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Mar 19 18:09:28.658061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync routers and router ports completed @ 2026-03-19 18:09:28.657602 {{(pid=103900) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:916}}
Mar 19 18:09:28.658213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync port QoS policies started @ 2026-03-19 18:09:28.658013 {{(pid=103900) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1341}}
Mar 19 18:09:28.658311 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] Starting OVNClientQosExtension
Mar 19 18:09:28.675655 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync port QoS policies completed @ 2026-03-19 18:09:28.675303 {{(pid=103900) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1364}}
Mar 19 18:09:28.675655 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync Floating IP QoS policies started @ 2026-03-19 18:09:28.675597 {{(pid=103900) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1369}}
Mar 19 18:09:28.675871 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] Starting OVNClientQosExtension
Mar 19 18:09:28.699909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync Floating IP QoS policies completed @ 2026-03-19 18:09:28.699577 {{(pid=103900) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1392}}
Mar 19 18:09:28.700214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync Floating IP NAT rules started @ 2026-03-19 18:09:28.699859 {{(pid=103900) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1397}}
Mar 19 18:09:28.700296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-NB Sync Floating IP NAT rules completed @ 2026-03-19 18:09:28.700152 {{(pid=103900) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1420}}
Mar 19 18:09:28.700368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-dd437faf-f7ca-4b76-8167-ffaa1c0a8cc9 None None] OVN-Northbound DB sync process completed @ 2026-03-19 18:09:28.700244 {{(pid=103900) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:111}}
Mar 19 18:09:37.919847 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Southbound DB sync process started @ 2026-03-19 18:09:37.919379 {{(pid=103900) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1448}}
Mar 19 18:09:37.921245 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Mar 19 18:09:37.922192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] OVN-SB Sync hostname and physical networks started @ 2026-03-19 18:09:37.921948 {{(pid=103900) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1475}}
Mar 19 18:09:37.927002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.927795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_dhcp_options_consistency {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.927976 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fair_meter_consistency {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fdb_aging_settings {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928180 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_igmp_snoop_support {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928258 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_inconsistencies {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928350 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_global_dhcp_opts {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928586 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_provider_distributed_ports {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928683 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.928962 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.configure_nb_global {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.929039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_fip_distributed_flag {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.929139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_network_type_and_physnet {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.929213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_ovn_owned_dns_option {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.929971 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_ha_failover {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.930078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.930530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_mac_aging_settings {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.930643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_qos_fip_rule_priority {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.930727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_distributed_flag {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.930819 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_static_routes {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.930954 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_security_group_with_address_group {{(pid=103900) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:99}}
Mar 19 18:09:37.931979 np0000160124 neutron-ovn-maintenance-worker[103900]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] New host np0000160124 found in OVN SB DB, but not in Neutron. Add its SegmentHostMapping in Neutron
Mar 19 18:09:37.933291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:37.935076 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] Maintenance task thread has started
Mar 19 18:09:37.939033 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:37.940369 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] MaintenanceWorker process has finished the post initialization
Mar 19 18:09:37.941306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:37.945333 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:37.949812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:37.952765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:37.954957 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:37.956976 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:37.972395 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4ba1d9-57c2-42ce-9df9-679b8206340e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:37.984374 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:37.986784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:37.988973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:37.992644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] Acquiring lock "update_segment_host_mapping" by "neutron.services.segments.db.update_segment_host_mapping" {{(pid=103900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}}
Mar 19 18:09:37.992915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] Lock "update_segment_host_mapping" acquired by "neutron.services.segments.db.update_segment_host_mapping" :: waited 0.000s {{(pid=103900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}}
Mar 19 18:09:37.996089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.004532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}}
Mar 19 18:09:38.005337 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.038791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.046857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.058833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.076459 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.085656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron_lib.callbacks.manager [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments-509413', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-15447974'] for segment_host_mapping (None), after_create {{(pid=103900) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}}
Mar 19 18:09:38.130306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:38.131351 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.164092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.170412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.172034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:38.173411 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-60d3742d-98e7-4712-8f34-16c0b2187cdd None None] Maintenance task: No inconsistencies found. Skipping {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:386}}
Mar 19 18:09:38.174106 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.180488 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:09:38.186346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.187570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.189820 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.222092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:38.233474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:38.233474 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.233474 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:38.233474 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.233474 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.233474 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:38.233474 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.233474 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:38.246623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:38.274259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in external_ids of LRPs. {{(pid=103900) update_lrouter_ports_ext_ids_name_prefix /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:503}}
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.320192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.321510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:38.322660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.322660 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.services.segments.db [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] Segments {'20b6196a-9254-4b37-a645-8253845242a7'} mapped to the host np0000160124 {{(pid=103900) update_segment_host_mapping /opt/stack/neutron/neutron/services/segments/db.py:249}}
Mar 19 18:09:38.324505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.335056 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.db.ovn_hash_ring_db [None req-ec949f3e-e805-43d9-ae44-44b8d83a2ab6 None None] Cleaned up Hash Ring nodes older than 5 days
Mar 19 18:09:38.351331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-da704ce6-3590-4996-842c-dace39e09abb None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.351703 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in LRPs (took 0.05 seconds)
Mar 19 18:09:38.363022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:38.363022 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.363022 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:38.363022 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.363022 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.363022 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:38.363022 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.363022 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:38.366376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-8c8c9700-ad8d-4b75-9cbf-8ea40a59edb4 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.371187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:38.372532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:38.398243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.399200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:38.399200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.399200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:38.399200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.399200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.399200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:38.399200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.399200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:38.404301 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_qos_fip_rule_priority' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.408182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.411671 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-7bc7d5fc-5889-446a-bd83-b310df9e5cf9 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.412003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:38.418821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG oslo_concurrency.lockutils [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] Lock "update_segment_host_mapping" "released" by "neutron.services.segments.db.update_segment_host_mapping" :: held 0.382s {{(pid=103900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}}
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' (it runs every 86400.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 919, in configure_nb_global
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:09:38.436398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:38.438446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.438446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:38.440781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-b5f8470e-af1a-481d-ba64-8b7a41c95e83 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_dhcp_options_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.442438 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.443477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_qos_fip_rule_priority' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.458288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:38.458288 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.458288 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:38.458288 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.458288 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.458288 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:38.458288 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.458288 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:38.462053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:38.465222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] OVN-SB Sync hostname and physical networks completed @ 2026-03-19 18:09:38.421601 {{(pid=103900) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1502}}
Mar 19 18:09:38.467147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:38.475183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.476346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:38.476346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.476346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:38.476346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.476346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.476346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:38.476346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.476346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:38.477237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.479084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-414acc5c-66fc-4346-aeac-91e4601d8c09 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.479426 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' {{(pid=103900) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}}
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:09:38.487137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.488297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-60d3742d-98e7-4712-8f34-16c0b2187cdd None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.488815 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:38.489178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.489583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:38.489583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.489583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:38.489583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.489583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.489583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:38.489583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.489583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:09:38.495687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.496200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:38.496722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.496722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:38.512570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:38.512760 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:38.512941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.513818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:38.513818 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.513818 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:38.513818 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.513818 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.513818 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:38.513818 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.513818 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.517431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.518377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:38.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.553278 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:38.554158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.562488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4ba1d9-57c2-42ce-9df9-679b8206340e None None] Traceback (most recent call last):
Mar 19 18:09:38.562488 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.562488 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:38.562488 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.562488 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.562488 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:38.562488 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.562488 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4ba1d9-57c2-42ce-9df9-679b8206340e None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.575518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:38.576664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:38.581427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-7bc7d5fc-5889-446a-bd83-b310df9e5cf9 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_security_group_with_address_group' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.584324 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [None req-183267ad-3059-406a-b02e-82124effc724 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=103900) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}}
Mar 19 18:09:38.617308 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-caee91c9-4e76-44d3-8349-54b5b45d7df6 None None] OVN-Southbound DB sync process completed @ 2026-03-19 18:09:38.616825 {{(pid=103900) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1456}}
Mar 19 18:09:40.309701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=41ab8d33-a7f7-4922-99aa-0bd744ca934d, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, gateway_chassis=[afceb737-2353-4ce6-8d3e-6a60eb14f251], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f1:7f:a7', name='lrp-afe65ee2-4f22-46c2-9a43-26d69a79fbe4', networks=['172.24.5.43/24'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=103900) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Mar 19 18:09:40.311718 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension
Mar 19 18:09:40.383973 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-3fbbc8ff-d939-4c17-8632-0e651722214d synchronized; highest priority chassis 64f26685-a59b-45f8-9ef3-c196cd8828ea
Mar 19 18:09:40.384950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'neutron:router_id': '1d7a9767-401e-4039-9ed1-c66e29e6fb30'}}) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:40.385541 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, chassis=64f26685-a59b-45f8-9ef3-c196cd8828ea, priority=1, columns={}) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:40.385990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:40.387324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:40.387324 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:40.387324 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:40.387324 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:40.387324 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:40.387324 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:40.387324 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:40.387324 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event Traceback (most recent call last):
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     match.run(event, row, updates)
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 88, in run
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:40.393326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self.create_transaction(
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.result = self.commit()
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise result.ex
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:40.394068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event 
Mar 19 18:09:42.954035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:42.957995 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:42.989822 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:42.990359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:42.992100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:09:42.992100 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:42.992100 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:42.992100 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:42.992100 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:42.992100 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:42.992100 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:42.992100 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:42.992631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:42.993143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:43.086519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:43.088390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:43.088766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.090072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:43.090072 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.090072 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:43.090072 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.090072 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.090072 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:43.090072 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.090072 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.092268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.093146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:43.179906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:43.181157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:09:43.182192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.183438 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:43.184850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:43.185792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:43.185792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.185792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:43.185792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.185792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.185792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:43.185792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.185792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:09:43.186494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.187327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.188270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:43.188270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.188270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:43.222227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:43.223941 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:43.224896 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:43.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:43.226349 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.226349 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:43.226349 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.226349 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.226349 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:43.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:43.227900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:43.228618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:43.228618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.228618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:43.228618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.228618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.228618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:43.228618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.228618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:09:43.229826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.230573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:43.231397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.231397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:43.374205 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:43.376198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:43.376821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:43.377321 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:43.377555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.378527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:43.378527 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.378527 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:43.378527 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.378527 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.378527 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:43.378527 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.378527 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.380279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.381074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:43.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=1fd6a63f-7770-41bc-8192-e1fb1c4cb197, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-3fbbc8ff-d939-4c17-8632-0e651722214d', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30', 'neutron:subnet_ids': '9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={'address_mode': 'slaac', 'mtu': '1372', 'send_periodic': 'true'}, mac='fa:16:3e:f2:59:d0', name='lrp-51b14df9-f53f-4f6d-9adf-612a6a5eafd7', networks=['fd1e:d06b:a5af::1/64'], options={}, peer=[], status={}) old= {{(pid=103900) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Mar 19 18:09:43.650486 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-3fbbc8ff-d939-4c17-8632-0e651722214d synchronized; highest priority chassis 64f26685-a59b-45f8-9ef3-c196cd8828ea
Mar 19 18:09:43.651375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'neutron:router_id': '1d7a9767-401e-4039-9ed1-c66e29e6fb30'}),), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:43.651805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, chassis=64f26685-a59b-45f8-9ef3-c196cd8828ea, priority=1, columns={}) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:43.652521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:43.653021 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.653021 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:43.653021 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.653021 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.653021 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:43.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.653021 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event Traceback (most recent call last):
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     match.run(event, row, updates)
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 85, in run
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self.create_transaction(
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.result = self.commit()
Mar 19 18:09:43.654211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise result.ex
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:43.654821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event 
Mar 19 18:09:45.734416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=41ab8d33-a7f7-4922-99aa-0bd744ca934d, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, gateway_chassis=[afceb737-2353-4ce6-8d3e-6a60eb14f251], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f1:7f:a7', name='lrp-afe65ee2-4f22-46c2-9a43-26d69a79fbe4', networks=['172.24.5.43/24'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={'hosting-chassis': '64f26685-a59b-45f8-9ef3-c196cd8828ea'}) old= {{(pid=103900) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Mar 19 18:09:45.735506 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=5051b110-7f46-4280-8118-80a56fee2f6f, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:revision_number': '8', 'neutron:router_name': 'neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2'}, gateway_chassis=[afceb737-2353-4ce6-8d3e-6a60eb14f251], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:f1:7f:a7', name='lrp-afe65ee2-4f22-46c2-9a43-26d69a79fbe4', networks=['172.24.5.43/24', '2001:db8::135/64'], options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=103900) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Mar 19 18:09:45.779737 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-3fbbc8ff-d939-4c17-8632-0e651722214d synchronized; highest priority chassis 64f26685-a59b-45f8-9ef3-c196cd8828ea
Mar 19 18:09:45.780658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'neutron:router_id': '1d7a9767-401e-4039-9ed1-c66e29e6fb30'}),), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:45.781045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, chassis=64f26685-a59b-45f8-9ef3-c196cd8828ea, priority=1, columns={}) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:45.781322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:45.782165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:45.782165 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:45.782165 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:45.782165 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:45.782165 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:45.782165 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:45.782165 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:45.782165 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event Traceback (most recent call last):
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     match.run(event, row, updates)
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 80, in run
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:45.783082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self.create_transaction(
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.result = self.commit()
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise result.ex
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:45.783677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event 
Mar 19 18:09:45.814148 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-3fbbc8ff-d939-4c17-8632-0e651722214d synchronized; highest priority chassis 64f26685-a59b-45f8-9ef3-c196cd8828ea
Mar 19 18:09:45.815269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'neutron:router_id': '1d7a9767-401e-4039-9ed1-c66e29e6fb30'}),), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:45.815917 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, chassis=64f26685-a59b-45f8-9ef3-c196cd8828ea, priority=1, columns={}) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:45.816317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:45.817416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:45.817416 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:45.817416 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:45.817416 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:45.817416 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:45.817416 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:45.817416 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:45.817416 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event Traceback (most recent call last):
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     match.run(event, row, updates)
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 88, in run
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.update_router_ha_chassis_group(
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1639, in update_router_ha_chassis_group
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.link_network_ha_chassis_group(context, network_id, router_id)
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:45.818635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self.create_transaction(
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.result = self.commit()
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise result.ex
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:45.819211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event 
Mar 19 18:09:47.955597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:47.959097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:47.994322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:47.994798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:47.996002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:09:47.996002 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:47.996002 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:47.996002 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:47.996002 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:47.996002 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:47.996002 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:47.996002 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:47.997029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:47.997988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:48.088740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:48.090987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:48.091479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.092684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:48.092684 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.092684 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:48.092684 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.092684 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.092684 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:48.092684 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.092684 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.094810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.095822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:48.181238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:48.182292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:09:48.182895 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:48.184114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.184361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:48.184361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.184361 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:48.184361 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.184361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.184361 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:48.184361 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.184361 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:48.185449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.186236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:48.186971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.187977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:48.223845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:48.224702 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:48.225318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:48.225599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.226252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:48.226252 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.226252 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:48.226252 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.226252 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.226252 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:48.226252 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.226252 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:48.227235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:48.227710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:48.227710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.227710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:48.227710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.227710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.227710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:48.227710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.227710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:09:48.228360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.228865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:48.229478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.229478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:48.376082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:48.377998 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:48.378956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:48.379443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:48.379648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.380615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:48.380615 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.380615 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:48.380615 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.380615 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.380615 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:48.380615 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.380615 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.382006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:48.382829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:52.957254 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:52.959602 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:52.997781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:52.998198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:52.999141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:09:52.999141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:52.999141 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:52.999141 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:52.999141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:52.999141 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:52.999141 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:52.999141 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.000328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.001233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:53.090183 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:53.092194 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:53.092640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.093506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:53.093506 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.093506 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:53.093506 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.093506 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.093506 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:53.093506 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.093506 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.095476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.096522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:53.182560 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:53.185517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:09:53.186197 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:53.186549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.187473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:53.187473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.187473 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:53.187473 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.187473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.187473 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:53.187473 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.187473 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:53.189512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:53.190912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:53.190912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.190912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:53.190912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.190912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.190912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:53.190912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.190912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:09:53.191593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.192448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.193302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:53.193302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.193302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:53.224967 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:53.226106 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:53.226682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:53.227087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.227782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:53.227782 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.227782 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:53.227782 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.227782 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.227782 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:53.227782 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.227782 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:53.228812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:53.229625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:53.229625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.229625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:53.229625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.229625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.229625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:53.229625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.229625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:09:53.230005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.230753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:53.231604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.231604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:53.377952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:53.379004 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:53.379710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:53.380085 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:53.380316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.381168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:53.381168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.381168 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:53.381168 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.381168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.381168 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:53.381168 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.381168 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.383564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:53.384489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:57.958607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:57.961758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:57.992598 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:57.993200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:57.994283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:09:57.994283 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:57.994283 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:57.994283 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:57.994283 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:57.994283 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:57.994283 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:57.994283 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:57.995350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:57.996007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:58.092817 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:58.094371 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:58.094707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.097694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:58.098613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.099531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.099531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:58.099531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.099531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:58.185730 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:58.186855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:09:58.187936 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:58.188220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.189023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:58.189023 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.189023 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:58.189023 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.189023 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.189023 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:58.189023 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.189023 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:58.190632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:58.191455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:58.191455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.191455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:58.191455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.191455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.191455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:58.191455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.191455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:09:58.192190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.193752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.195228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:58.195228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.195228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:58.226238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:58.227439 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:58.228165 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:58.228629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.229640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:58.229640 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.229640 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:58.229640 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.229640 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.229640 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:58.229640 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.229640 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:09:58.230959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:58.231738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:09:58.231738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.231738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:09:58.231738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.231738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.231738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:09:58.231738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.231738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:09:58.232819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.233726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:58.234352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.234352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:09:58.379212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:09:58.382532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:09:58.383274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:58.383602 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:09:58.383749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.386695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:09:58.387836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:09:58.388670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:09:58.388670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:09:58.388670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:09:58.388670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:02.960749 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:02.965094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:02.999201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:03.000015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.001041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:10:03.001041 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.001041 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:03.001041 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.001041 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.001041 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:03.001041 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.001041 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.002332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.003247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:03.094007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:03.096091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:03.096499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.097659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:03.097659 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.097659 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:03.097659 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.097659 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.097659 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:03.097659 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.097659 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.099536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.100048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:03.187058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:03.188527 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:03.189296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:03.189799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.190846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:03.190846 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.190846 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:03.190846 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.190846 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.190846 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:03.190846 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.190846 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:03.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:03.192229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:03.192229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.192229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:03.192229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.192229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.192229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:03.192229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.192229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:03.192845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.193323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.193803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:03.193803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.193803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:03.227678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:03.229748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:03.230292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:03.230771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.231805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:03.231805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.231805 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:03.231805 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.231805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.231805 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:03.231805 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.231805 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:03.233616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:03.234209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:03.234209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.234209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:03.234209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.234209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.234209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:03.234209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.234209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:03.236356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.236932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:03.237531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.237531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:03.382757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:03.384213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:03.385138 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:03.385593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:03.385829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.387299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:03.387299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.387299 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:03.387299 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.387299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.387299 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:03.387299 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.387299 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.390294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:03.391088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:07.963236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:07.965706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:08.002655 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:08.003069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.004301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:10:08.004301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.004301 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:08.004301 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.004301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.004301 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:08.004301 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.004301 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.005593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.007216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:08.095510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:08.098073 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:08.098509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.099766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:08.099766 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.099766 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:08.099766 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.099766 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.099766 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:08.099766 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.099766 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.101776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.102628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:08.188638 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:08.189874 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:08.190395 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:08.190717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.191424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:08.191424 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.191424 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:08.191424 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.191424 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.191424 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:08.191424 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.191424 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:08.192420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:08.193016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:08.193016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.193016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:08.193016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.193016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.193016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:08.193016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.193016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:08.193536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.194023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.194528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:08.194528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.194528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:08.229199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:08.230338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:08.231144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:08.231666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.232695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:08.232695 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.232695 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:08.232695 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.232695 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.232695 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:08.232695 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.232695 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:08.233786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:08.234305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:08.234305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.234305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:08.234305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.234305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.234305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:08.234305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.234305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:08.235131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.235642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:08.236203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.236203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:08.384162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:08.385147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:08.385627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:08.385953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:08.386166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:08.386726 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.386726 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:08.386726 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.386726 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.386726 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:08.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.387775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:08.388342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:12.964694 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:12.967171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:13.001806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:13.001980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.002521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:10:13.002521 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.002521 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:13.002521 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.002521 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.002521 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:13.002521 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.002521 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.003428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.003984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:13.097381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:13.099532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:13.100280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.101317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:13.101317 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.101317 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:13.101317 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.101317 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.101317 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:13.101317 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.101317 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.103400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.104250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:13.190140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:13.194120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:13.194915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:13.195841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.196629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:13.196629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.196629 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:13.196629 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.196629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.196629 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:13.196629 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.196629 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:13.198182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:13.199172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:13.199172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.199172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:13.199172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.199172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.199172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:13.199172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.199172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:13.199812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.200724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.202442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:13.202442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.202442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:13.230344 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:13.233242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:13.233982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:13.234462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.235376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:13.235376 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.235376 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:13.235376 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.235376 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.235376 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:13.235376 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.235376 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:13.236331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:13.236736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:13.236736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.236736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:13.236736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.236736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.236736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:13.236736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.236736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:13.237722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.238278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:13.238825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.238825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:13.385953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:13.388745 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:13.390358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:13.390691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:13.390862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.391737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:13.391737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.391737 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:13.391737 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.391737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.391737 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:13.391737 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.391737 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.394122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:13.395003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:17.966238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:17.968749 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:18.009820 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:18.010423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.011508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:10:18.011508 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.011508 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:18.011508 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.011508 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.011508 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:18.011508 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.011508 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.012802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.013629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:18.098935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:18.100495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:18.100768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.101732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:18.101732 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.101732 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:18.101732 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.101732 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.101732 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:18.101732 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.101732 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.103264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.103844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:18.194187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:18.195027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:18.195615 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:18.195904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.196557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:18.196557 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.196557 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:18.196557 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.196557 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.196557 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:18.196557 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.196557 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:18.197753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:18.198755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:18.198755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.198755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:18.198755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.198755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.198755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:18.198755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.198755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:18.199527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.200443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.201096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:18.201096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.201096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:18.232972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:18.233835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:18.234520 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.236539 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:18.237144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:18.238065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:18.238065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.238065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:18.238065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.238065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.238065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:18.238065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.238065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:18.242484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.243371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:18.244026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.244026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:18.389015 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:18.390504 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:18.391190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:18.391618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:18.391809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.392748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:18.392748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.392748 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:18.392748 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.392748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.392748 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:18.392748 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.392748 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.394604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:18.395468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:22.968211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:22.971825 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:23.005277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:23.005277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.005579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:10:23.005579 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.005579 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:23.005579 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.005579 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.005579 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:23.005579 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.005579 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.006682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.007147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:23.100284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:23.103047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:23.103240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.104408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:23.104408 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.104408 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:23.104408 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.104408 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.104408 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:23.104408 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.104408 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.106941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.108032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:23.195399 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:23.196665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:23.197288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:23.197624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.198499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:23.198499 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.198499 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:23.198499 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.198499 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.198499 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:23.198499 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.198499 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:23.199942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:23.201097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:23.201097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.201097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:23.201097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.201097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.201097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:23.201097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.201097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:23.201575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.202579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.203754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:23.203754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.203754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:23.234037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:23.235105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:23.235586 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:23.235924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.236597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:23.236597 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.236597 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:23.236597 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.236597 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.236597 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:23.236597 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.236597 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:23.237487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:23.238299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:23.238299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.238299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:23.238299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.238299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.238299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:23.238299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.238299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:23.240098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.240983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:23.241919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.241919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:23.390413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:23.391785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:23.392651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:23.393231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:23.393514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.394519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:23.394519 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.394519 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:23.394519 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.394519 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.394519 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:23.394519 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.394519 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.395822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:23.396431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:27.970799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:27.976508 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:27.979132 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=433,neutron:INSERT=1,neutron:UPDATE=2,neutron:DELETE=1 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:10:28.028468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:28.028468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.029633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:10:28.029633 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.029633 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:28.029633 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.029633 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.029633 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:28.029633 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.029633 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.031057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.031712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:28.101867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:28.103551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:28.103810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.104622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:28.104622 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.104622 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:28.104622 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.104622 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.104622 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:28.104622 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.104622 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.106748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.107741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:28.196825 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:28.198046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:28.198707 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:28.199213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.200465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:28.200465 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.200465 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:28.200465 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.200465 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.200465 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:28.200465 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.200465 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:28.202111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:28.202663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:28.202663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.202663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:28.202663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.202663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.202663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:28.202663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.202663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:28.204140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.204600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.205157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:28.205157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.205157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:28.235419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:28.236810 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:28.237286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:28.237690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.238597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:28.238597 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.238597 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:28.238597 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.238597 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.238597 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:28.238597 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.238597 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:28.240733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:28.241517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:28.241517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.241517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:28.241517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.241517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.241517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:28.241517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.241517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:28.242482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.243379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:28.244273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.244273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:28.392490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:28.393712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:28.394356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:28.394800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:28.395107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.396021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:28.396021 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.396021 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:28.396021 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.396021 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.396021 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:28.396021 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.396021 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.398103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:28.399158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:32.975941 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:32.978508 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:33.012634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:33.013037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.013901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:10:33.013901 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.013901 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:33.013901 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.013901 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.013901 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:33.013901 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.013901 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.014821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.015744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:33.102945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:33.104782 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:33.105119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.106049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:33.106049 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.106049 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:33.106049 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.106049 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.106049 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:33.106049 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.106049 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.108049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.109132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.227540 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:33.229173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.230048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:33.230827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.231936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:33.236679 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:33.238017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:33.238743 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:33.239131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.239897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:33.239897 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.239897 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:33.239897 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.239897 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.239897 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:33.239897 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.239897 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:33.241306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:33.241913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:33.241913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.241913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:33.241913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.241913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.241913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:33.241913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.241913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:33.242599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.243193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:33.243826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.243826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:33.409021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:33.410612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:33.411268 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:33.411567 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:33.411746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.412543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:33.412543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.412543 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:33.412543 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.412543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.412543 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:33.412543 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.412543 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.414591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:33.415184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:37.977556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:37.980003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:38.018060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:38.018601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.019686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:10:38.019686 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.019686 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:38.019686 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.019686 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.019686 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:38.019686 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.019686 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.020595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.021176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:38.104572 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:38.106326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:38.106759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.107861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:38.107861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.107861 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:38.107861 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.107861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.107861 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:38.107861 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.107861 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.109784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.110637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:38.200128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:38.201292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:38.202132 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:38.202498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.203490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:38.203490 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.203490 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:38.203490 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.203490 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.203490 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:38.203490 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.203490 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:38.205464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:38.206409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:38.206409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.206409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:38.206409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.206409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.206409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:38.206409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.206409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:38.207324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.208220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.209161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:38.209161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.209161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:38.238052 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:38.238676 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:38.240241 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:38.240723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.241785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:38.241785 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.241785 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:38.241785 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.241785 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.241785 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:38.241785 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.241785 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:38.243356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:38.244143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:38.244143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.244143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:38.244143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.244143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.244143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:38.244143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.244143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:38.245229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.246061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:38.246906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.246906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:38.410584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:38.411494 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:38.412391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:38.412909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:38.413161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.414139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:38.414139 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.414139 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:38.414139 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.414139 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.414139 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:38.414139 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.414139 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.416363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:38.417273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:42.978824 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:42.980693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:43.019165 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:43.019509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.020581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:10:43.020581 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.020581 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:43.020581 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.020581 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.020581 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:43.020581 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.020581 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.030937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.031673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:43.105984 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:43.107870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:43.108352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.109414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:43.109414 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.109414 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:43.109414 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.109414 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.109414 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:43.109414 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.109414 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.111385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.112346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:43.201387 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:43.202163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:43.203367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:43.203901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.204813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:43.204813 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.204813 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:43.204813 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.204813 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.204813 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:43.204813 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.204813 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:43.206622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:43.207710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:43.207710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.207710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:43.207710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.207710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.207710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:43.207710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.207710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:43.209164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.210015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.210654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:43.210654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.210654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:43.238634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:43.239007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:43.239575 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:43.239831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.240505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:43.240505 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.240505 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:43.240505 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.240505 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.240505 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:43.240505 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.240505 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:43.241996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:43.243017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:43.243017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.243017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:43.243017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.243017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.243017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:43.243017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.243017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:43.244246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.245071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:43.246056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.246056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:43.411457 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:43.412470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:43.413422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:43.413916 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:43.414112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.415104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:43.415104 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.415104 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:43.415104 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.415104 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.415104 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:43.415104 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.415104 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.417011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:43.417783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:47.979798 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:47.982437 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:48.016228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:48.016664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.017726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:10:48.017726 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.017726 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:48.017726 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.017726 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.017726 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:48.017726 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.017726 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.019336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.019829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:48.107170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:48.109062 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:48.109313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.110380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:48.110380 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.110380 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:48.110380 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.110380 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.110380 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:48.110380 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.110380 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.112753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.113733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:48.202481 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:48.202924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:48.203785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:48.204067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.204765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:48.204765 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.204765 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:48.204765 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.204765 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.204765 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:48.204765 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.204765 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:48.205979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:48.206858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:48.206858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.206858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:48.206858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.206858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.206858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:48.206858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.206858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:48.207586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.208474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.209554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:48.209554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.209554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:48.239294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:48.239713 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:48.240323 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:48.240586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.241193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:48.241193 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.241193 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:48.241193 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.241193 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.241193 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:48.241193 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.241193 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:48.242293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:48.242783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:48.242783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.242783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:48.242783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.242783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.242783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:48.242783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.242783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:48.243318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.243819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:48.244385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.244385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:48.412519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:48.413495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:48.414505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:48.414788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:48.414926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.415751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:48.415751 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.415751 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:48.415751 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.415751 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.415751 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:48.415751 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.415751 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.417519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:48.418258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:52.981585 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:52.983804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:53.025148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:53.025301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.026003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:10:53.026003 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.026003 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:53.026003 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.026003 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.026003 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:53.026003 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.026003 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.027144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.028398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:53.108700 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:53.110303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:53.110609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.111490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:53.111490 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.111490 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:53.111490 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.111490 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.111490 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:53.111490 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.111490 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.113208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.114299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:53.203541 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:53.204684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:53.205668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:53.206114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.207131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:53.207131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.207131 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:53.207131 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.207131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.207131 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:53.207131 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.207131 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:53.208739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:53.209517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:53.209517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.209517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:53.209517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.209517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.209517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:53.209517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.209517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:53.210710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.211447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.212298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:53.212298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.212298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:53.240151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:53.240974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:53.241645 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:53.242003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.242697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:53.242697 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.242697 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:53.242697 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.242697 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.242697 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:53.242697 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.242697 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:53.244239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:53.244680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:53.244680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.244680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:53.244680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.244680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.244680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:53.244680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.244680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:53.246113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.246538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:53.247063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.247063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:53.413657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:53.414492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:53.415342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:53.415836 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:53.416102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.417192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:53.417192 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.417192 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:53.417192 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.417192 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.417192 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:53.417192 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.417192 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.419026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:53.419989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:57.982638 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:57.984748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:58.022821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:58.023367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.024371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:10:58.024371 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.024371 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:58.024371 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.024371 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.024371 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:58.024371 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.024371 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.025663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.027098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:58.109911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:58.111710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:58.112181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.113174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:58.113174 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.113174 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:58.113174 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.113174 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.113174 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:58.113174 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.113174 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.115112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.115999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:58.204705 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:58.205330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:10:58.206451 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:58.206451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.207341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:58.207341 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.207341 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:58.207341 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.207341 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.207341 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:58.207341 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.207341 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:58.208279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.209497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:58.210345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.211321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:58.241312 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:58.241930 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:58.242446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:58.242903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.244046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:58.244046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.244046 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:58.244046 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.244046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.244046 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:58.244046 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.244046 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:10:58.245083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:58.245868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:10:58.245868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.245868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:10:58.245868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.245868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.245868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:10:58.245868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.245868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:10:58.246617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.247421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:58.248340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.248340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:10:58.414487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:10:58.415288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:10:58.415984 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:58.416288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:10:58.416426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.417247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:10:58.417247 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.417247 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:10:58.417247 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.417247 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.417247 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:10:58.417247 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.417247 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.419352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:10:58.420047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:02.983253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:02.985228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:03.022445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:03.022865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.023931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:11:03.023931 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.023931 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:03.023931 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.023931 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.023931 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:03.023931 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.023931 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.025300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.026006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:03.110773 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:03.112336 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:03.112628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.113584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:03.113584 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.113584 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:03.113584 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.113584 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.113584 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:03.113584 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.113584 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.116207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.117125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:03.205631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:03.206438 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:03.207121 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:03.207499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.208365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:03.208365 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.208365 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:03.208365 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.208365 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.208365 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:03.208365 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.208365 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:03.209572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:03.210105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:03.210105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.210105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:03.210105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.210105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.210105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:03.210105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.210105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:03.211357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.212316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.212940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:03.212940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.212940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:03.241943 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:03.242563 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:03.243275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:03.243625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.244424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:03.244424 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.244424 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:03.244424 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.244424 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.244424 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:03.244424 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.244424 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:03.246249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:03.246773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:03.246773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.246773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:03.246773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.246773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.246773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:03.246773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.246773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:03.248146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.248651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:03.249200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.249200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:03.415332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:03.416292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:03.417095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:03.417947 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:03.418148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.419114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:03.419114 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.419114 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:03.419114 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.419114 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.419114 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:03.419114 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.419114 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.421137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:03.422102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:07.984616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:07.986385 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:08.022056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:08.022507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.023624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:11:08.023624 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.023624 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:08.023624 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.023624 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.023624 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:08.023624 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.023624 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.024611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.025582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:08.111941 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:08.113593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:08.114028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.115166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:08.115166 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.115166 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:08.115166 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.115166 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.115166 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:08.115166 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.115166 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.117080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.117994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:08.206948 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:08.207780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:08.208805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:08.209209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.210208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:08.210208 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.210208 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:08.210208 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.210208 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.210208 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:08.210208 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.210208 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:08.211716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:08.212691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:08.212691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.212691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:08.212691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.212691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.212691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:08.212691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.212691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:08.213324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.214262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.215338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:08.215338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.215338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:08.242598 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:08.243244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:08.243759 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:08.244122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.244768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:08.244768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.244768 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:08.244768 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.244768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.244768 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:08.244768 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.244768 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:08.245692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:08.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:08.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:08.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:08.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:08.246899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.247371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:08.247944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.247944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:08.416158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:08.417252 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:08.418033 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:08.418442 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:08.418647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.419566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:08.419566 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.419566 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:08.419566 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.419566 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.419566 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:08.419566 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.419566 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.421296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:08.422328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:12.985545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:12.987674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:13.023579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:13.024169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.024899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:11:13.024899 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.024899 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:13.024899 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.024899 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.024899 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:13.024899 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.024899 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.025897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.026317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:13.113036 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:13.114484 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:13.114840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.115926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:13.115926 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.115926 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:13.115926 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.115926 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.115926 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:13.115926 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.115926 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.118106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.119133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:13.208161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:13.208553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:13.209344 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:13.209681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.210647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:13.210647 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.210647 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:13.210647 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.210647 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.210647 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:13.210647 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.210647 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:13.212034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:13.212996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:13.212996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.212996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:13.212996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.212996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.212996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:13.212996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.212996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:13.213749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.214579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.215575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:13.215575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.215575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:13.243390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:13.244026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:13.244803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:13.245386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:13.246418 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.246418 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:13.246418 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.246418 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.246418 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:13.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.246418 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:13.247953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:13.248407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:13.248407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.248407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:13.248407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.248407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.248407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:13.248407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.248407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:13.249708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.250577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:13.251564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.251564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:13.417256 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:13.417716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:13.418688 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:13.419231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:13.419447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.420456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:13.420456 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.420456 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:13.420456 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.420456 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.420456 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:13.420456 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.420456 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.422273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:13.423400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:17.986572 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:17.988351 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:18.022595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:18.022595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.023361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:11:18.023361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.023361 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:18.023361 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.023361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.023361 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:18.023361 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.023361 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.024535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.025530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:18.113793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:18.115456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:18.115851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.117207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:18.117207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.117207 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:18.117207 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.117207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.117207 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:18.117207 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.117207 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.119909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.120650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:18.209055 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:18.209588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:18.210558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:18.210965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.212030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:18.212030 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.212030 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:18.212030 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.212030 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.212030 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:18.212030 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.212030 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:18.213196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:18.214007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:18.214007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.214007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:18.214007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.214007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.214007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:18.214007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.214007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:18.214424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.215315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.216202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:18.216202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.216202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:18.244232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:18.244524 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:18.245546 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:18.246122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.247626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:18.247626 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.247626 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:18.247626 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.247626 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.247626 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:18.247626 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.247626 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:18.249282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:18.249781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:18.249781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.249781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:18.249781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.249781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.249781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:18.249781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.249781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:18.251304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.252476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:18.253465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.253465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:18.417922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:18.418273 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:18.419131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:18.419474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:18.419629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.420717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:18.420717 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.420717 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:18.420717 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.420717 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.420717 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:18.420717 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.420717 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.422034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:18.422713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:22.987315 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:22.989420 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:23.023426 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:23.024051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.025211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:11:23.025211 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.025211 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:23.025211 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.025211 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.025211 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:23.025211 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.025211 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.026200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.027056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:23.114814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:23.116231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:23.116505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.117513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:23.117513 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.117513 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:23.117513 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.117513 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.117513 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:23.117513 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.117513 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.119907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.120954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:23.210153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:23.210955 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:23.211597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:23.212101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.213385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:23.213385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.213385 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:23.213385 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.213385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.213385 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:23.213385 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.213385 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:23.214150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:23.215016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:23.215016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.215016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:23.215016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.215016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.215016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:23.215016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.215016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:23.215396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.216322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.217319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:23.217319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.217319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:23.244766 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:23.245599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:23.246613 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:23.247114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.248060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:23.248060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.248060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:23.248060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.248060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.248060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:23.248060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.248060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:23.249266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:23.250040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:23.250040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.250040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:23.250040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.250040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.250040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:23.250040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.250040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:23.250535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.251356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:23.252205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.252205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:23.418693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:23.419208 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:23.420286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:23.420817 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:23.421076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.422022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:23.422022 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.422022 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:23.422022 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.422022 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.422022 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:23.422022 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.422022 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.423233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:23.424245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:27.988042 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:27.989801 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:28.015835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=253 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:11:28.025225 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:28.025674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.026602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:11:28.026602 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.026602 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:28.026602 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.026602 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.026602 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:28.026602 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.026602 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.027953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.028537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:28.115593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:28.117040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:28.117556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.118688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:28.118688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.118688 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:28.118688 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.118688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.118688 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:28.118688 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.118688 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.120706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.121997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:28.211025 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:28.211718 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:28.212945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:28.213943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.214685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:28.214685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.214685 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:28.214685 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.214685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.214685 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:28.214685 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.214685 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:28.216427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:28.217442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:28.217442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.217442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:28.217442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.217442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.217442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:28.217442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.217442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:28.218561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.239828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.240281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:28.240281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.240281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:28.245446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:28.246075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:28.246903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:28.247435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.248417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:28.248417 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.248417 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:28.248417 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.248417 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.248417 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:28.248417 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.248417 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:28.249430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:28.249950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:28.249950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.249950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:28.249950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.249950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.249950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:28.249950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.249950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:28.250483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.268107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:28.269020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.269020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:28.419954 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:28.420301 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:28.421222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:28.421866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:28.422139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.423221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:28.423221 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.423221 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:28.423221 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.423221 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.423221 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:28.423221 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.423221 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.425048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:28.445256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:32.988956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:32.991202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:33.031253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:33.031598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.032564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:11:33.032564 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.032564 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:33.032564 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.032564 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.032564 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:33.032564 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.032564 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.033859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.034695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:33.116459 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:33.118062 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:33.118498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.119715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:33.119715 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.119715 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:33.119715 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.119715 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.119715 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:33.119715 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.119715 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.122567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.123591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:33.211827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:33.212477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:33.213470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:33.213765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.214960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:33.214960 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.214960 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:33.214960 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.214960 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.214960 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:33.214960 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.214960 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:33.215680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.216667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:33.217459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.218320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:33.246355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:33.247091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:33.248588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:33.249137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.250231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:33.250231 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.250231 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:33.250231 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.250231 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.250231 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:33.250231 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.250231 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:33.251827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:33.252400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:33.252400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.252400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:33.252400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.252400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.252400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:33.252400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.252400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:33.253668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.254547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:33.255576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.255576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:33.420386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:33.421241 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:33.422289 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:33.422840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:33.423202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.424313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:33.424313 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.424313 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:33.424313 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.424313 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.424313 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:33.424313 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.424313 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.427107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:33.428028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:37.989499 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:37.991159 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:38.034035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:38.034527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.036171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:11:38.036171 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.036171 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:38.036171 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.036171 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.036171 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:38.036171 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.036171 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.037519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.038242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:38.117304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:38.118792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:38.119122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.120108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:38.120108 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.120108 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:38.120108 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.120108 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.120108 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:38.120108 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.120108 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.122023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.122935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:38.212811 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:38.213624 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:38.214578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:38.215017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.216084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:38.216084 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.216084 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:38.216084 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.216084 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.216084 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:38.216084 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.216084 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:38.217643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:38.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:38.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:38.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:38.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:38.220163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.221078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.221842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:38.221842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.221842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:38.247000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:38.247527 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:38.248522 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:38.249036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.250012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:38.250012 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.250012 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:38.250012 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.250012 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.250012 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:38.250012 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.250012 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:38.251298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:38.252147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:38.252147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.252147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:38.252147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.252147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.252147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:38.252147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.252147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:38.252682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.253435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:38.254341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.254341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:38.421116 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:38.421528 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:38.422175 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:38.422402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:38.422531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.423095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:38.423095 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.423095 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:38.423095 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.423095 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.423095 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:38.423095 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.423095 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.424414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:38.425256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:42.990257 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:42.992257 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:43.025717 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:43.026142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.027166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:11:43.027166 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.027166 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:43.027166 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.027166 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.027166 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:43.027166 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.027166 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.028455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.029483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:43.118148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:43.119609 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:43.119998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.120994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:43.120994 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.120994 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:43.120994 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.120994 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.120994 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:43.120994 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.120994 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.123083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.124069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:43.213799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:43.214434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:43.215384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:43.215661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.216533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:43.216533 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.216533 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:43.216533 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.216533 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.216533 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:43.216533 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.216533 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:43.217897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:43.218759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:43.218759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.218759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:43.218759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.218759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.218759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:43.218759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.218759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:43.219477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.220330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.221291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:43.221291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.221291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:43.247564 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:43.247940 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:43.248845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:43.249217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.250060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:43.250060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.250060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:43.250060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.250060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.250060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:43.250060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.250060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:43.251592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:43.252448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:43.252448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.252448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:43.252448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.252448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.252448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:43.252448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.252448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:43.253365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.254046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:43.254603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.254603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:43.422128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:43.422762 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:43.423792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:43.424287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:43.424287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.425147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:43.425147 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.425147 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:43.425147 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.425147 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.425147 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:43.425147 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.425147 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.427295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:43.428288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:47.994127 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:47.996629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:48.037198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:48.037788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.039079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:11:48.039079 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.039079 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:48.039079 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.039079 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.039079 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:48.039079 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.039079 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.040451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.040858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:48.118987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:48.120534 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:48.120948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.121985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:48.121985 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.121985 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:48.121985 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.121985 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.121985 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:48.121985 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.121985 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.123844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.124224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:48.214501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:48.214977 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:48.215999 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:48.216365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.217345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:48.217345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.217345 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:48.217345 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.217345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.217345 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:48.217345 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.217345 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:48.218771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:48.219637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:48.219637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.219637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:48.219637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.219637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.219637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:48.219637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.219637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:48.220495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.221121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.221867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:48.221867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.221867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:48.248124 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:48.248544 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:48.249301 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:48.249676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.250618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:48.250618 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.250618 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:48.250618 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.250618 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.250618 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:48.250618 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.250618 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:48.252155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:48.253044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:48.253044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.253044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:48.253044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.253044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.253044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:48.253044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.253044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:48.253829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.254673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:48.255670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.255670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:48.422754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:48.423453 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:48.424486 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:48.424945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:48.425150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.426118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:48.426118 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.426118 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:48.426118 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.426118 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.426118 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:48.426118 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.426118 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.427893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:48.428570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:52.996095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:52.998605 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:53.032427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:53.033003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.034064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:11:53.034064 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.034064 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:53.034064 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.034064 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.034064 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:53.034064 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.034064 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.035035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.035948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:53.119897 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:53.121285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:53.121590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.122314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:53.122314 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.122314 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:53.122314 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.122314 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.122314 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:53.122314 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.122314 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.124135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.125147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:53.215219 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:53.215918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:53.217014 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:53.217358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.218269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:53.218269 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.218269 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:53.218269 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.218269 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.218269 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:53.218269 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.218269 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:53.219821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:53.221091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:53.221091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.221091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:53.221091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.221091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.221091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:53.221091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.221091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:53.222090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.223056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.223980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:53.223980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.223980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:53.248959 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:53.249666 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:53.250444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:53.251420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.251745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:53.251745 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.251745 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:53.251745 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.251745 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.251745 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:53.251745 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.251745 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:53.253579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:53.254396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:53.254396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.254396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:53.254396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.254396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.254396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:53.254396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.254396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:53.255380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.256162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:53.256635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.256635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:53.423580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:53.424454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:53.425147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:53.425603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:53.425820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:53.426793 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.426793 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:53.426793 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.426793 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.426793 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:53.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.428508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:53.429399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:57.996816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:57.999448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:58.031620 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:58.032090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.033266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:11:58.033266 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.033266 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:58.033266 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.033266 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.033266 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:58.033266 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.033266 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.034859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.035445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:58.120927 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:58.122090 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:58.122537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.123564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:58.123564 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.123564 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:58.123564 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.123564 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.123564 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:58.123564 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.123564 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.124608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.125215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:58.216010 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:58.216688 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:11:58.218028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:58.218369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.219334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:58.219334 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.219334 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:58.219334 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.219334 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.219334 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:58.219334 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.219334 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:58.221565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:58.222201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:58.222201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.222201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:58.222201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.222201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.222201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:58.222201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.222201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:11:58.222859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.223386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.223943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:58.223943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.223943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:58.249737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:58.250316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:58.250961 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:58.251291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.252075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:58.252075 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.252075 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:58.252075 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.252075 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.252075 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:58.252075 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.252075 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:11:58.253431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:58.253947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:11:58.253947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.253947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:11:58.253947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.253947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.253947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:11:58.253947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.253947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:11:58.255080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.255605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:58.256256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.256256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:11:58.424290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:11:58.424988 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:11:58.425506 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:58.425833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:11:58.426032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.426735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:11:58.426735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.426735 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:11:58.426735 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.426735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.426735 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:11:58.426735 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.426735 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.427988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:11:58.428543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:02.997866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:03.000095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:03.035975 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:03.036555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.037706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:12:03.037706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.037706 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:03.037706 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.037706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.037706 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:03.037706 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.037706 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.039029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.039821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:03.121386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:03.123178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:03.123739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.124911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:03.124911 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.124911 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:03.124911 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.124911 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.124911 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:03.124911 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.124911 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.126784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.127629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:03.216623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:03.217178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:03.218184 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:03.218575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.219586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:03.219586 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.219586 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:03.219586 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.219586 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.219586 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:03.219586 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.219586 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:03.221215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:03.222006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:03.222006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.222006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:03.222006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.222006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.222006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:03.222006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.222006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:03.222828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.223566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.224443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:03.224443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.224443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:03.250295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:03.250956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:03.251600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:03.252101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.252918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:03.252918 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.252918 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:03.252918 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.252918 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.252918 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:03.252918 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.252918 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:03.253854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:03.254660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:03.254660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.254660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:03.254660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.254660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.254660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:03.254660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.254660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:03.255062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.255796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:03.256693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.256693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:03.425133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:03.425572 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:03.426425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:03.426863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:03.427030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.428004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:03.428004 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.428004 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:03.428004 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.428004 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.428004 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:03.428004 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.428004 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.429798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:03.430771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:07.998861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:08.000192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:08.034057 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:08.034588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.035586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:12:08.035586 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.035586 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:08.035586 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.035586 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.035586 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:08.035586 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.035586 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.036873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.037832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:08.122222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:08.124070 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:08.124918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.125642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:08.125642 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.125642 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:08.125642 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.125642 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.125642 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:08.125642 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.125642 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.127725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.128641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:08.217738 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:08.219152 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:08.220143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:08.220543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.221595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:08.221595 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.221595 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:08.221595 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.221595 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.221595 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:08.221595 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.221595 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:08.223068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:08.223926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:08.223926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.223926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:08.223926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.223926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.223926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:08.223926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.223926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:08.225061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.225984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.227065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:08.227065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.227065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:08.251177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:08.251596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:08.252318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:08.252851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.253660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:08.253660 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.253660 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:08.253660 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.253660 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.253660 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:08.253660 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.253660 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:08.255678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:08.256363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:08.256363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.256363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:08.256363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.256363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.256363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:08.256363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.256363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:08.257833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.258410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:08.258965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.258965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:08.426323 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:08.427067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:08.427763 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:08.428074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:08.428184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.429109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:08.429109 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.429109 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:08.429109 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.429109 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.429109 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:08.429109 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.429109 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.431413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:08.433010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:12.999595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:13.001086 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:13.037289 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:13.037564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.038547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:12:13.038547 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.038547 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:13.038547 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.038547 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.038547 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:13.038547 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.038547 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.039388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.040454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:13.123270 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:13.124744 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:13.125167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.126060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:13.126060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.126060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:13.126060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.126060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.126060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:13.126060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.126060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.127608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.128389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:13.218588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:13.219176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:13.220561 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:13.221142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.222409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:13.222409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.222409 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:13.222409 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.222409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.222409 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:13.222409 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.222409 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:13.223601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:13.224773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:13.224773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.224773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:13.224773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.224773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.224773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:13.224773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.224773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:13.225193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.225927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.226667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:13.226667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.226667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:13.251684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:13.252279 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:13.253321 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:13.253839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.254906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:13.254906 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.254906 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:13.254906 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.254906 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.254906 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:13.254906 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.254906 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:13.256354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:13.256851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:13.256851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.256851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:13.256851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.256851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.256851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:13.256851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.256851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:13.257914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.258421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:13.258997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.258997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:13.426925 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:13.427692 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:13.428577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:13.429206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:13.429408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.430380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:13.430380 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.430380 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:13.430380 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.430380 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.430380 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:13.430380 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.430380 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.432156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:13.433243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:18.000237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:18.001973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:18.039466 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:18.039981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.041156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:12:18.041156 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.041156 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:18.041156 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.041156 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.041156 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:18.041156 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.041156 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.042468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.043560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:18.124160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:18.125593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:18.125865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.127015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:18.127015 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.127015 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:18.127015 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.127015 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.127015 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:18.127015 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.127015 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.129106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.130020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:18.219432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:18.220237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:18.221179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:18.221574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.222672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:18.222672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.222672 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:18.222672 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.222672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.222672 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:18.222672 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.222672 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:18.224224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:18.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:18.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:18.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:18.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.225328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:18.225986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.226769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.227812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:18.227812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.227812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:18.252277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:18.252811 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:18.253462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:18.254186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.254983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:18.254983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.254983 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:18.254983 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.254983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.254983 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:18.254983 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.254983 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:18.255858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:18.256615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:18.256615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.256615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:18.256615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.256615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.256615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:18.256615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.256615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:18.257000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.257743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:18.258648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.258648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:18.427776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:18.428658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:18.429818 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:18.430425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:18.430721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.432777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:18.432777 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.432777 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:18.432777 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.432777 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.432777 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:18.432777 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.432777 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.434918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:18.436175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:23.000902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:23.002616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:23.045079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:23.045509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.046541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:12:23.046541 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.046541 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:23.046541 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.046541 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.046541 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:23.046541 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.046541 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.047994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.049083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:23.125176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:23.127031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:23.127545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.128895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:23.128895 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.128895 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:23.128895 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.128895 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.128895 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:23.128895 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.128895 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.130733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.131583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:23.220211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:23.220899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:23.221661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:23.222057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.222961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:23.222961 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.222961 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:23.222961 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.222961 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.222961 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:23.222961 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.222961 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:23.224302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:23.225129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:23.225129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.225129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:23.225129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.225129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.225129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:23.225129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.225129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:23.225511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.226362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.227335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:23.227335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.227335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:23.253079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:23.253669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:23.254400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:23.254910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.256097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:23.256097 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.256097 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:23.256097 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.256097 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.256097 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:23.256097 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.256097 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:23.258178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:23.258873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:23.258873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.258873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:23.258873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.258873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.258873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:23.258873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.258873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:23.260270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.261389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:23.261808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.261808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:23.428578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:23.429091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:23.429697 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:23.430179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:23.430372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.431297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:23.431297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.431297 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:23.431297 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.431297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.431297 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:23.431297 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.431297 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.432869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:23.433670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:28.001609 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:28.003448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:28.039818 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:28.040168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.040976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:12:28.040976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.040976 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:28.040976 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.040976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.040976 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:28.040976 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.040976 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.042213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.043592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:28.125831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:28.127477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:28.127852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.129079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:28.129079 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.129079 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:28.129079 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.129079 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.129079 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:28.129079 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.129079 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.131040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.132488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:28.221150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:28.221521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:28.222235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:28.222615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.223632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:28.223632 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.223632 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:28.223632 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.223632 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.223632 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:28.223632 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.223632 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:28.225187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:28.226123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:28.226123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.226123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:28.226123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.226123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.226123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:28.226123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.226123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:28.226968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.228039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.228710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:28.228710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.228710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:28.253533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:28.253849 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:28.254381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:28.254758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.255683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:28.255683 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.255683 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:28.255683 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.255683 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.255683 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:28.255683 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.255683 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:28.256900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:28.257655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:28.257655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.257655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:28.257655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.257655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.257655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:28.257655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.257655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:28.258576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.259109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:28.259771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.259771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:28.429432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:28.429959 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:28.430965 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:28.431424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:28.431641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.432713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:28.432713 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.432713 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:28.432713 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.432713 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.432713 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:28.432713 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.432713 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.434241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:28.435068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:33.002402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:33.004182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:33.006170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=247 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:12:33.052585 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:33.053051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.054032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:12:33.054032 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.054032 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:33.054032 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.054032 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.054032 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:33.054032 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.054032 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.055235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.056263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:33.126651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:33.128266 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:33.128787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.129971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:33.129971 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.129971 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:33.129971 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.129971 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.129971 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:33.129971 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.129971 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.131371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.132599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:33.222038 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:33.222685 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:33.223478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:33.223823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.224651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:33.224651 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.224651 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:33.224651 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.224651 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.224651 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:33.224651 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.224651 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:33.225438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.226349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:33.227334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.227931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:33.254261 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:33.254599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:33.256056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:33.256532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.257627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:33.257627 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.257627 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:33.257627 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.257627 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.257627 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:33.257627 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.257627 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:33.259241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:33.260093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:33.260093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.260093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:33.260093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.260093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.260093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:33.260093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.260093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:33.261145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.261973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:33.262952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.262952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:33.430359 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:33.431214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:33.431964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:33.432520 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:33.432791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.433796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:33.433796 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.433796 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:33.433796 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.433796 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.433796 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:33.433796 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.433796 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.435872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:33.436699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:38.003781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:38.004662 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:38.041529 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:38.041997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.043116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:12:38.043116 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.043116 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:38.043116 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.043116 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.043116 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:38.043116 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.043116 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.044516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.045309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:38.127452 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:38.129054 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:38.129540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.130493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:38.130493 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.130493 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:38.130493 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.130493 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.130493 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:38.130493 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.130493 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.131799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.132319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:38.222771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:38.223793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:38.224484 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:38.224833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.225794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:38.225794 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.225794 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:38.225794 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.225794 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.225794 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:38.225794 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.225794 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:38.227344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:38.228191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:38.228191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.228191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:38.228191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.228191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.228191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:38.228191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.228191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:38.229501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.229996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.230498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:38.230498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.230498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:38.255075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:38.255566 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:38.256089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:38.256313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.256850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:38.256850 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.256850 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:38.256850 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.256850 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.256850 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:38.256850 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.256850 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:38.257606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.258508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:38.259440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.260740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:38.431093 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:38.431713 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:38.432411 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:38.433015 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:38.433314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.434275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:38.434275 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.434275 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:38.434275 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.434275 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.434275 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:38.434275 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.434275 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.435367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:38.436238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:43.003981 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:43.006394 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:43.040657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:43.041262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.042457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:12:43.042457 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.042457 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:43.042457 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.042457 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.042457 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:43.042457 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.042457 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.043914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.045011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.142333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.143282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.144447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:43.223547 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:43.224217 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:43.224795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:43.225162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.225965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:43.225965 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.225965 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:43.225965 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.225965 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.225965 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:43.225965 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.225965 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:43.227136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:43.228297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:43.228297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.228297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:43.228297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.228297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.228297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:43.228297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.228297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:43.228796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.229773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.230917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:43.230917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.230917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:43.255983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:43.256602 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:43.257415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:43.257825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.258822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:43.258822 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.258822 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:43.258822 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.258822 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.258822 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:43.258822 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.258822 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:43.260377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:43.261013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:43.261013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.261013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:43.261013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.261013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.261013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:43.261013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.261013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:43.262056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.262655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:43.263475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.263475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:43.431974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:43.432360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:43.433178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:43.433468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:43.433623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.434630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:43.434630 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.434630 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:43.434630 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.434630 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.434630 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:43.434630 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.434630 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.436435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:43.437549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:48.004816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:48.005990 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:48.042448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:48.042636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.043142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:12:48.043142 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.043142 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:48.043142 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.043142 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.043142 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:48.043142 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.043142 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.044155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.045139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:48.128929 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:48.130410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:48.130724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.131759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:48.131759 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.131759 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:48.131759 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.131759 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.131759 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:48.131759 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.131759 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.134241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:48.224443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:48.224872 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:48.226008 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:48.226462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.227682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:48.227682 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.227682 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:48.227682 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.227682 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.227682 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:48.227682 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.227682 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:48.229211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:48.230059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:48.230059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.230059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:48.230059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.230059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.230059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:48.230059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.230059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:48.230775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.231702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.232691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:48.232691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.232691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:48.256829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:48.257390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:48.258312 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:48.258670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.259493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:48.259493 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.259493 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:48.259493 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.259493 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.259493 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:48.259493 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.259493 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:48.260868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:48.261693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:48.261693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.261693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:48.261693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.261693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.261693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:48.261693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.261693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:48.262802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.263612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:48.264497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.264497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.518284 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:48.519179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:48.520112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:53.005630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:53.007164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:53.043096 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:53.043347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.043983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:12:53.043983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.043983 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:53.043983 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.043983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.043983 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:53.043983 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.043983 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.045049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.045601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.176566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.177109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.177678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:53.225054 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:53.227901 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:53.228524 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:53.228790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.230134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:53.230134 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.230134 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:53.230134 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.230134 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.230134 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:53.230134 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.230134 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:53.230958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:53.231708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:53.231708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.231708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:53.231708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.231708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.231708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:53.231708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.231708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:53.232115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.232789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.233556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:53.233556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.233556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:53.257479 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:53.258330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:53.259148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:53.259633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.260635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:53.260635 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.260635 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:53.260635 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.260635 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.260635 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:53.260635 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.260635 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:53.261798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:53.263006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:53.263006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.263006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:53.263006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.263006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.263006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:53.263006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.263006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:53.263517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.264574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:53.265440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.265440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:53.433343 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:53.434048 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:53.434755 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:53.435310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:53.435521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.436462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:53.436462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.436462 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:53.436462 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.436462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.436462 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:53.436462 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.436462 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.438257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:53.439195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:58.006633 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:58.008543 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:58.044903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:58.045242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.046028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:12:58.046028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.046028 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:58.046028 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.046028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.046028 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:58.046028 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.046028 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.047038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.048037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:58.130398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:58.131725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:58.132027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.132868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:58.132868 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.132868 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:58.132868 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.132868 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.132868 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:58.132868 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.132868 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.134511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.135248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:58.225897 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:58.226427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:12:58.227088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:58.227449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.228244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:58.228244 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.228244 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:58.228244 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.228244 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.228244 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:58.228244 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.228244 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:58.228814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:58.229320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:58.229320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.229320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:58.229320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.229320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.229320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:58.229320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.229320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:12:58.229809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.230795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.231973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:58.231973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.231973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:58.258198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:58.258723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:58.259443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:58.259818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.260659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:58.260659 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.260659 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:58.260659 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.260659 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.260659 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:58.260659 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.260659 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:12:58.262295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:58.263023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:12:58.263023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.263023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:12:58.263023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.263023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.263023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:12:58.263023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.263023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:12:58.264094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.265618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:58.266256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.266256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:12:58.434120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:12:58.434765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:12:58.435386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:58.435796 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:12:58.436013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.436811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:12:58.436811 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.436811 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:12:58.436811 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.436811 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.436811 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:12:58.436811 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.436811 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.438970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:12:58.439739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:03.007390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:03.009279 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:03.050182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:03.050675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.051708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:13:03.051708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.051708 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:03.051708 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.051708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.051708 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:03.051708 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.051708 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.052755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.053579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:03.131403 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:03.132850 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:03.133211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.134069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:03.134069 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.134069 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:03.134069 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.134069 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.134069 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:03.134069 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.134069 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.136106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.136913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:03.226748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:03.227246 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:03.228220 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:03.228627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.229507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:03.229507 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.229507 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:03.229507 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.229507 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.229507 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:03.229507 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.229507 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:03.230608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:03.231402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:03.231402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.231402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:03.231402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.231402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.231402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:03.231402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.231402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:03.232004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.232721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.233535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:03.233535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.233535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:03.258900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:03.259587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:03.260565 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:03.260962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.261720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:03.261720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.261720 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:03.261720 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.261720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.261720 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:03.261720 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.261720 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:03.263280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:03.264025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:03.264025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.264025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:03.264025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.264025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.264025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:03.264025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.264025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:03.264916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.265636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:03.266381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.266381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:03.434753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:03.435739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:03.436610 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:03.437162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:03.437375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.438587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:03.438587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.438587 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:03.438587 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.438587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.438587 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:03.438587 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.438587 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.440244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:03.440776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:08.008545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:08.010477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:08.047781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:08.048141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.049046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:13:08.049046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.049046 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:08.049046 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.049046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.049046 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:08.049046 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.049046 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.050494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.051350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:08.132411 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:08.133774 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:08.134191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.135565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:08.135565 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.135565 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:08.135565 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.135565 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.135565 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:08.135565 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.135565 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.137780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:08.263448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:08.264657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:08.265193 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:08.265739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:08.266410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:08.266937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.267731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:08.267731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.267731 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:08.267731 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.267731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.267731 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:08.267731 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.267731 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:08.268370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:08.268869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:08.269418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.270050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.270654 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:08.271340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:08.271927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:08.271927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.271927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:08.271927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.271927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.271927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:08.271927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.271927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:08.272445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.273039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:08.273620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.273620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:08.435815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:08.436640 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:08.437490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:08.438092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:08.438390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.440070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:08.440070 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.440070 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:08.440070 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.440070 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.440070 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:08.440070 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.440070 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:08.441501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:13.009389 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:13.010859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:13.046813 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:13.047294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.048444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:13:13.048444 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.048444 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:13.048444 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.048444 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.048444 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:13.048444 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.048444 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.049396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.050564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:13.133342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:13.134840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:13.135261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.136357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:13.136357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.136357 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:13.136357 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.136357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.136357 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:13.136357 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.136357 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.138199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.138986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:13.265300 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:13.266005 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:13.266939 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:13.267951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:13.268697 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:13.312197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.313415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:13.314787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:13.315579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.316757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.317841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.318788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:13.319694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:13.320592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.320592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:13.320592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.320592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.320592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:13.320592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.320592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:13.436816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:13.438759 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:13.441105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:13.441105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:13.441105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.441750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:13.441750 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.441750 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:13.441750 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.441750 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.441750 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:13.441750 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.441750 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.444953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:13.445507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:18.010115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:18.013667 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:18.055382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:18.055520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.056417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:13:18.056417 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.056417 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:18.056417 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.056417 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.056417 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:18.056417 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.056417 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.057714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.058565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:18.134245 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:18.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:18.136172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.137263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:18.137263 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.137263 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:18.137263 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.137263 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.137263 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:18.137263 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.137263 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.139235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.139984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:18.266259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:18.267071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:18.267953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:18.268957 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:18.269458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:18.269686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.270833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:18.270833 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.270833 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:18.270833 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.270833 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.270833 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:18.270833 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.270833 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:18.272627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:18.273611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:18.274403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.275129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.275849 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:18.277013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:18.277626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:18.277626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.277626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:18.277626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.277626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.277626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:18.277626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.277626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:18.279754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.280470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:18.281249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.281249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:18.441077 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:18.441077 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:18.441077 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:18.441077 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:18.441077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.441919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:18.441919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.441919 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:18.441919 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.441919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.441919 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:18.441919 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.441919 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.443684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:18.444668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:23.013102 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:23.015144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:23.051816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:23.052215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.053251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:13:23.053251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.053251 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:23.053251 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.053251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.053251 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:23.053251 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.053251 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.054703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.055640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:23.134926 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:23.136601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:23.137077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.138102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:23.138102 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.138102 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:23.138102 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.138102 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.138102 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:23.138102 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.138102 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.139916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.140975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:23.267421 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:23.268327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:23.268715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:23.269558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:23.270868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:23.271273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.272192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:23.272192 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.272192 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:23.272192 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.272192 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.272192 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:23.272192 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.272192 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:23.274166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:23.274988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:23.274988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.274988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:23.274988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.274988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.274988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:23.274988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.274988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:23.275707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.276599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.277670 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:23.279201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:23.279610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:23.279610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.279610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:23.279610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.279610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.279610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:23.279610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.279610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:23.281589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.282237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:23.282726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.282726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:23.439770 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:23.440621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:23.441736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:23.442149 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:23.442301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.443089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:23.443089 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.443089 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:23.443089 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.443089 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.443089 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:23.443089 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.443089 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.444378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:23.444944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:28.013902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:28.015597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:28.051801 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:28.052307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.053297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:13:28.053297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.053297 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:28.053297 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.053297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.053297 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:28.053297 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.053297 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.054288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.055060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:28.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:28.137169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:28.137548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.138604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:28.138604 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.138604 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:28.138604 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.138604 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.138604 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:28.138604 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.138604 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.140017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:28.268555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:28.269224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:28.269659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:28.270355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:28.271320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:28.271766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.272846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:28.272846 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.272846 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:28.272846 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.272846 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.272846 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:28.272846 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.272846 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:28.274467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:28.275318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:28.277193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.278074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.278902 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:28.279580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:28.280307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:28.280307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.280307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:28.280307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.280307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.280307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:28.280307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.280307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:28.281358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.282162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:28.282989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.282989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:28.440624 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:28.441406 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:28.442275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:28.442716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:28.442917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.443760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:28.443760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.443760 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:28.443760 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.443760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.443760 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:28.443760 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.443760 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.445077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:28.446123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:33.014823 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:33.016593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:33.018637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:13:33.055690 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:33.056280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.057385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:13:33.057385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.057385 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:33.057385 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.057385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.057385 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:33.057385 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.057385 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.060100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.060635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:33.136656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:33.138232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:33.138701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.139735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:33.139735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.139735 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:33.139735 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.139735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.139735 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:33.139735 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.139735 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.142238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.142952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:33.269221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:33.269933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:33.270362 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:33.271013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:33.271826 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:33.272313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.273412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:33.273412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.273412 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:33.273412 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.273412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.273412 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:33.273412 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.273412 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:33.275152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:33.276030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:33.276030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.276030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:33.276030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.276030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.276030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:33.276030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.276030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:33.276920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.278021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.278992 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:33.280650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:33.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:33.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:33.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:33.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:33.282993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.283846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:33.284960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.284960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:33.441602 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:33.442704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:33.443412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:33.443751 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:33.444000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.444990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:33.444990 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.444990 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:33.444990 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.444990 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.444990 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:33.444990 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.444990 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.446865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:33.447724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:38.015680 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:38.017341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:38.058052 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:38.058613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.059829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:13:38.059829 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.059829 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:38.059829 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.059829 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.059829 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:38.059829 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.059829 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.061176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.061972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:38.137352 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:38.138716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:38.139090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.139956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:38.139956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.139956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:38.139956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.139956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.139956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:38.139956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.139956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.141751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.142479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:38.270066 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:38.270529 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:38.270964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:38.272134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:38.272134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:38.272701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.273734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:38.273734 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.273734 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:38.273734 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.273734 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.273734 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:38.273734 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.273734 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:38.275728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:38.277592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:38.278631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:38.280496 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:38.281062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:38.281520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.281960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.282445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:38.442451 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:38.443345 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:38.444285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:38.444725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:38.444959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.446330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:38.446330 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.446330 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:38.446330 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.446330 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.446330 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:38.446330 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.446330 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.448756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:38.449374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:43.019566 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:43.020518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:43.057945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:43.058228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.059083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:13:43.059083 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.059083 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:43.059083 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.059083 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.059083 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:43.059083 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.059083 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.060126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.062625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:43.138264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:43.139472 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:43.139910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.140891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:43.140891 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.140891 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:43.140891 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.140891 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.140891 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:43.140891 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.140891 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.141899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.142471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:43.270746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:43.271569 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:43.272011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:43.272565 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:43.274670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.275080 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:43.276053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:43.276488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.277283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:43.277283 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.277283 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:43.277283 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.277283 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.277283 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:43.277283 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.277283 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:43.278110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:43.278744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:43.278744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.278744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:43.278744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.278744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.278744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:43.278744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.278744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:43.279099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.279767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:43.280580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.283131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:43.284621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.285945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:43.286401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.286401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:43.443356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:43.444268 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:43.445166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:43.445758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:43.446023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.447173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:43.447173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.447173 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:43.447173 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.447173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.447173 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:43.447173 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.447173 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.449082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:43.449785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:48.018970 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:48.020937 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:48.054207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:48.054702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.055726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Traceback (most recent call last):
Mar 19 18:13:48.055726 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.055726 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:48.055726 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.055726 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.055726 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:48.055726 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.055726 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.056773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.057709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:48.139036 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:48.140201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:48.140522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.141373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:48.141373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.141373 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:48.141373 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.141373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.141373 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:48.141373 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.141373 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.143251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.144038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:48.271684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:48.272355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:48.273181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:48.273581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.274631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:48.275183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:48.275183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.275183 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:48.275183 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.275183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.275183 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:48.275183 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.275183 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:48.276971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:48.277735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:48.277735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.277735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:48.277735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.277735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.277735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:48.277735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.277735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:48.278540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.279260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.279890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:48.279890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.279890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:48.279890 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:48.279890 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:48.279890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.280461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:48.280461 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.280461 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:48.280461 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.280461 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.280461 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:48.280461 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.280461 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:48.282002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:48.282406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:48.282406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.282406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:48.282406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.282406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.282406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:48.282406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.282406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:48.284324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.284785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:48.285279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.285279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:48.444355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:48.444712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:48.445335 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:48.445746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:48.445971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.446915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:48.446915 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.446915 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:48.446915 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.446915 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.446915 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:48.446915 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.446915 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:48.449340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:53.019733 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:53.021340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:53.063051 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:53.063525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.064614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Traceback (most recent call last):
Mar 19 18:13:53.064614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.064614 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:53.064614 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.064614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.064614 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:53.064614 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.064614 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.065744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.067067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:53.139785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:53.141327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:53.141758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.142951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:53.142951 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.142951 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:53.142951 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.142951 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.142951 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:53.142951 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.142951 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.146916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:53.272596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:53.273673 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:53.274536 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:53.275012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.276070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:53.276070 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.276070 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:53.276070 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.276070 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.276070 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:53.276070 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.276070 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:53.277059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:53.280708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.281345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:53.281976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.282732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.285478 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:53.287421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:53.288402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:53.288402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.288402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:53.288402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.288402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.288402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:53.288402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.288402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:53.289285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.289927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:53.290594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.290594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:53.445064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:53.445867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:53.446862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:53.447590 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:53.447897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.448902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:53.448902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.448902 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:53.448902 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.448902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.448902 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:53.448902 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.448902 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.450810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:53.451804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:58.020371 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:58.022179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:58.060159 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:58.060468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.061142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:13:58.061142 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.061142 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:58.061142 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.061142 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.061142 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:58.061142 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.061142 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.062320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.062697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:58.140669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:58.142500 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:58.142970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.144018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:58.144018 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.144018 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:58.144018 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.144018 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.144018 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:58.144018 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.144018 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.145978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.146759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:58.273682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:58.274307 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:13:58.275365 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:58.275739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.276481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:58.276481 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.276481 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:58.276481 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.276481 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.276481 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:58.276481 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.276481 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:58.277966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:58.278726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:58.278726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.278726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:58.278726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.278726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.278726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:58.278726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.278726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:13:58.279581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.280364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.281247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:58.281247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.281247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:58.281247 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:58.281607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:58.282164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:58.282368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.282987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:58.282987 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.282987 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:58.282987 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.282987 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.282987 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:58.282987 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.282987 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:13:58.284450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:58.285161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:13:58.285161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.285161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:13:58.285161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.285161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.285161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:13:58.285161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.285161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:13:58.286200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.287564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:58.288711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.288711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:13:58.445810 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:13:58.446455 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:13:58.447395 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:58.447916 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:13:58.448168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.449267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:13:58.449267 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.449267 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:13:58.449267 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.449267 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.449267 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:13:58.449267 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.449267 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.450979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:13:58.451761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:03.031234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:03.031234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:03.071444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:03.071682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.072333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:14:03.072333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.072333 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:03.072333 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.072333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.072333 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:03.072333 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.072333 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.073413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.074316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:03.141370 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:03.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:03.143071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.143997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:03.143997 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.143997 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:03.143997 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.143997 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.143997 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:03.143997 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.143997 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.145727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.146681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:03.274305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:03.275005 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:03.276242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:03.276610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.277676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:03.277676 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.277676 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:03.277676 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.277676 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.277676 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:03.277676 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.277676 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:03.279259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:03.280374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:03.280374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.280374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:03.280374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.280374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.280374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:03.280374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.280374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:03.280936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.281950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.282636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:03.282636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.282636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:03.282636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:03.282636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:03.282636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:03.282636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.283470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:03.283470 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.283470 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:03.283470 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.283470 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.283470 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:03.283470 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.283470 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:03.284419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:03.285056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:03.285056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.285056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:03.285056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.285056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.285056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:03.285056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.285056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:03.285545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.286213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:03.286921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.286921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:03.446600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:03.447226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:03.448169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:03.448686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:03.448940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.450040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:03.450040 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.450040 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:03.450040 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.450040 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.450040 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:03.450040 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.450040 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.452116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:03.452575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:08.022366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:08.024021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:08.063633 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:08.064746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.066325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Traceback (most recent call last):
Mar 19 18:14:08.066325 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.066325 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:08.066325 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.066325 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.066325 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:08.066325 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.066325 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.067362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.068150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:08.142146 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:08.144406 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:08.144406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.144749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:08.144749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.144749 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:08.144749 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.144749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.144749 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:08.144749 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.144749 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.146586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.147055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:08.275333 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:08.276037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:08.277144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:08.277629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.278585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:08.278585 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.278585 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:08.278585 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.278585 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.278585 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:08.278585 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.278585 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:08.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:08.280741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:08.280741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.280741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:08.280741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.280741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.280741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:08.280741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.280741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:08.281547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.282343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.283199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:08.283199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.283199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:08.283199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:08.283199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:08.283199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:08.283594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.284362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:08.284362 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.284362 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:08.284362 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.284362 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.284362 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:08.284362 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.284362 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:08.285752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:08.286553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:08.286553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.286553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:08.286553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.286553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.286553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:08.286553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.286553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:08.287483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.288124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:08.288681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.288681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:08.447569 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:08.447908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:08.448705 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:08.449171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:08.449373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.450282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:08.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:08.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:08.450282 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.450282 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.452101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:08.452939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:13.023075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:13.025056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:13.058237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:13.058645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.059513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Traceback (most recent call last):
Mar 19 18:14:13.059513 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.059513 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:13.059513 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.059513 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.059513 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:13.059513 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.059513 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.060455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.061256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:13.142848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:13.144365 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:13.144736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.145672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:13.145672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.145672 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:13.145672 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.145672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.145672 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:13.145672 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.145672 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.147655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.148432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:13.276627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:13.277023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:13.277951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:13.278309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.279313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:13.279313 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.279313 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:13.279313 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.279313 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.279313 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:13.279313 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.279313 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:13.280737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:13.281489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:13.281489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.281489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:13.281489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.281489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.281489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:13.281489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.281489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:13.282390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.284114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.285032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:13.285032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.285032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:13.285032 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:13.285032 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:13.285032 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:13.285032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.285398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:13.285398 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.285398 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:13.285398 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.285398 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.285398 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:13.285398 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.285398 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:13.286700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:13.287451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:13.287451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.287451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:13.287451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.287451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.287451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:13.287451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.287451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:13.287979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.288853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:13.289471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.289471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:13.448406 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:13.448780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:13.449567 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:13.450010 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:13.450295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.451235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:13.451235 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.451235 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:13.451235 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.451235 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.451235 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:13.451235 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.451235 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.453019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:13.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:18.023830 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:18.025807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:18.144605 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:18.146196 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:18.146603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.148406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:18.148406 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.148406 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:18.148406 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.148406 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.148406 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:18.148406 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.148406 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.151774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.152730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:18.269664 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:18.270200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.271607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Traceback (most recent call last):
Mar 19 18:14:18.271607 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.271607 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:18.271607 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.271607 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.271607 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:18.271607 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.271607 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-b9e0787e-0530-47de-a039-353d0b089ff5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.275259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.276069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:18.278045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:18.278316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:18.280083 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:18.280458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.281407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:18.281407 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.281407 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:18.281407 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.281407 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.281407 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:18.281407 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.281407 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:18.283295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:18.284185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:18.284185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.284185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:18.284185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.284185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.284185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:18.284185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.284185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:18.284619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.285433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.286988 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:18.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.288053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:18.288280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.288835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:18.289674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.289674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:18.449240 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:18.450035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:18.451074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:18.451497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:18.451694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.452650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:18.452650 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.452650 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:18.452650 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.452650 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.452650 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:18.452650 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.452650 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.454488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:18.455023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:23.024847 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:23.026985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:23.064699 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:23.065178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.066243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:14:23.066243 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.066243 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:23.066243 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.066243 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.066243 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:23.066243 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.066243 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.067333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.068345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:23.145410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:23.146992 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:23.147366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.150541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:23.151499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.152393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.152393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:23.152393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.152393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:23.278009 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:23.278932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:23.279438 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:23.279701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.280443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:23.280443 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.280443 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:23.280443 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.280443 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.280443 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:23.280443 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.280443 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:23.281778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:23.283207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:23.283207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.283207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:23.283207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.283207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.283207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:23.283207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.283207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:23.283788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.284647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.285748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:23.285748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.285748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:23.285748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:23.286067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:23.286632 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:23.287684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.287925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:23.287925 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.287925 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:23.287925 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.287925 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.287925 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:23.287925 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.287925 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:23.289410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:23.290226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:23.290226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.290226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:23.290226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.290226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.290226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:23.290226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.290226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:23.291292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.292077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:23.292981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.292981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:23.422403 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=c1069476-7467-47ea-b5b2-e0ed29c0b085, enabled=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2'}, gateway_chassis=[8607aab6-2078-46f2-a441-d2105bc2d2ea], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:11:31:8c', name='lrp-f319bf7e-5d34-47af-b620-bec8597c3819', networks=['172.24.5.52/24', '2001:db8::2c3/64'], options={'gateway_mtu': '1430', 'reside-on-redirect-chassis': 'true'}, peer=[], status={}) old= {{(pid=103900) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Mar 19 18:14:23.449814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:23.451160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:23.451647 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:23.452176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:23.452406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.453434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:23.453434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.453434 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:23.453434 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.453434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.453434 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:23.453434 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.453434 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.455034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:23.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:26.071670 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(uuid=eb71c9cf-81d1-4019-9cc6-7e39088c8e27, enabled=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809', 'neutron:subnet_ids': '0bc68cc0-48dc-4abe-bbac-0a4f654efb2e'}, gateway_chassis=[], ha_chassis_group=[], ipv6_prefix=[], ipv6_ra_configs={}, mac='fa:16:3e:57:ec:08', name='lrp-8e3d911d-6489-48c4-8808-db102f2abac4', networks=['192.168.24.1/24'], options={}, peer=[], status={}) old= {{(pid=103900) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}}
Mar 19 18:14:26.137494 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6 synchronized; highest priority chassis 64f26685-a59b-45f8-9ef3-c196cd8828ea
Mar 19 18:14:26.138169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): HAChassisGroupAddCommand(_result=None, name=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, may_exist=True, columns={'external_ids': {'neutron:availability_zone_hints': '', 'neutron:network_id': '4d64a793-ee68-4a18-b938-f55304c6fcf6', 'neutron:router_id': 'cf5e0251-94c8-4bce-b873-648b8cc72809'}}) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:26.138641 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, chassis=64f26685-a59b-45f8-9ef3-c196cd8828ea, priority=1, columns={}) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:26.139083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:26.139866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:26.139866 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:26.139866 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:26.139866 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:26.139866 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:26.139866 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:26.139866 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:26.139866 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event Traceback (most recent call last):
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     match.run(event, row, updates)
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 85, in run
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.l3_plugin._ovn_client.link_network_ha_chassis_group(
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2385, in link_network_ha_chassis_group
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     next(self.gen)
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     with self.create_transaction(
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     self.result = self.commit()
Mar 19 18:14:26.141689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                   ^^^^^^^^^^^^^
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise result.ex
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     txn.results.put(txn.do_commit())
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event                     ^^^^^^^^^^^^^^^
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event     raise RuntimeError(msg)
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:26.142746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.event 
Mar 19 18:14:28.025767 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:28.028190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:28.071705 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:28.072077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.073111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:14:28.073111 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.073111 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:28.073111 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.073111 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.073111 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:28.073111 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.073111 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.074496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.075378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:28.146343 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:28.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:28.148071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:28.148379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.149377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:28.149377 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.149377 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:28.149377 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.149377 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.149377 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:28.149377 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.149377 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.151963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.152840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:28.278916 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:28.279814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:28.280866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:28.281281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:28.284301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:28.285248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:28.285248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.285248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:28.285248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.285248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.285248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:28.285248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.285248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:28.285692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.286403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.287233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:28.287233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.287233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:28.287233 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:28.287482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:28.288176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:28.288560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.289296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:28.289296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.289296 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:28.289296 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.289296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.289296 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:28.289296 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.289296 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:28.290552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:28.291150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:28.291150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.291150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:28.291150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.291150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.291150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:28.291150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.291150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:28.292468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.293090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:28.293758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.293758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:28.450945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:28.451950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:28.452557 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:28.453065 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:28.453317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.455937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:28.456841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:28.457692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:28.457692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:28.457692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:28.457692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:33.026781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:33.028518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:33.030600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=257 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:14:33.073481 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:33.073481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.073832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:14:33.073832 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.073832 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:33.073832 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.073832 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.073832 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:33.073832 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.073832 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.075222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.076063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:33.147158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:33.150232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:33.150232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:33.150232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.150589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:33.150589 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.150589 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:33.150589 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.150589 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.150589 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:33.150589 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.150589 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.151909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.152832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:33.279699 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:33.280340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:33.282144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:33.282144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.282403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:33.282403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.282403 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:33.282403 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.282403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.282403 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:33.282403 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.282403 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:33.283857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:33.284613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:33.284613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.284613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:33.284613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.284613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.284613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:33.284613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.284613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:33.285501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.286328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.287193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:33.287193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.287193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:33.287456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:33.287703 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:33.288723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:33.288723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.288892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:33.288892 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.288892 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:33.288892 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.288892 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.288892 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:33.288892 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.288892 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:33.289723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:33.290156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:33.290156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.290156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:33.290156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.290156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.290156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:33.290156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.290156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:33.290744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.291167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:33.291653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.291653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:33.452097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:33.452807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:33.453608 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:33.454199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:33.454464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.455420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:33.455420 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.455420 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:33.455420 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.455420 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.455420 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:33.455420 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.455420 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.457236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:33.458143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:37.985495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:37.996308 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:389}}
Mar 19 18:14:37.996687 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Number of inconsistencies found at create/update: networks=3, security_groups=1 {{(pid=103900) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:370}}
Mar 19 18:14:37.996867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Fixing resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:14:38.027632 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:38.032071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:38.042171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, resource={'id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'name': 'private', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb', 'bee598c2-f62b-4321-b08d-23e3a7c6ccb9'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:09:27Z', 'updated_at': '2026-03-19T18:09:31Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 29513}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.042617 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.043214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b55270e8-5359-4f54-8804-fcbd7769eee3, external_ids_update=None, columns={'tag': 29513}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.043502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.048771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:14:38.048771 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.048771 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:38.048771 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.048771 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.048771 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:38.048771 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.048771 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Failed to fix resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:14:38.051461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.051891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.052327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:14:38.052327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.052327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:14:38.052327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Fixing resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:14:38.115445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.116219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.117606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:14:38.117606 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.117606 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:38.117606 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.117606 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.117606 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:38.117606 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.117606 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.120904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.121453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:38.126682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, resource={'id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'name': 'public', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['7888df47-ce34-4091-9e08-c1c5949f53a2', 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-03-19T18:09:34Z', 'updated_at': '2026-03-19T18:09:44Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.127109 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.127518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-20b6196a-9254-4b37-a645-8253845242a7, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.127769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.128644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:14:38.128644 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.128644 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:38.128644 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.128644 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.128644 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:38.128644 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.128644 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Failed to fix resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:14:38.130048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.130401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.130764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:14:38.130764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.130764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:14:38.130764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Fixing resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:14:38.147948 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:38.150580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.151092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.151445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.153345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:38.153345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.153345 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:38.153345 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.153345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.153345 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:38.153345 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.153345 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.155587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.156120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:38.169738 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-420e2995-aa57-46db-9651-85807f50bcb9, resource={'id': '420e2995-aa57-46db-9651-85807f50bcb9', 'name': 'admin_net', 'tenant_id': '1ed140779dbc462d89fd3e785886b2bb', 'project_id': '1ed140779dbc462d89fd3e785886b2bb', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['388b450f-f17e-4671-94e9-9f169d754be7'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:13:33Z', 'updated_at': '2026-03-19T18:13:34Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 28229}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.170181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-420e2995-aa57-46db-9651-85807f50bcb9, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.170767 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-07b4049d-60f0-4621-a8e7-5dcac93308be, external_ids_update=None, columns={'tag': 28229}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.171013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.172108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:14:38.172108 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.172108 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:38.172108 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.172108 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.172108 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:38.172108 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.172108 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Failed to fix resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:14:38.174361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.174690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.175089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:14:38.175089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.175089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:14:38.175089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Fixing resource 3b12010b-73bb-4575-816d-f2cca7d3d854 (type: security_groups) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:14:38.237793 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.db.ovn_revision_numbers_db [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Successfully bumped revision number for resource 3b12010b-73bb-4575-816d-f2cca7d3d854 (type: security_groups) to 9
Mar 19 18:14:38.237793 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Maintenance task: Synchronization completed (took 0.24 seconds)
Mar 19 18:14:38.280533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:38.281194 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:38.282054 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.282494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.283484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:38.283484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.283484 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:38.283484 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.283484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.283484 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:38.283484 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.283484 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:38.284833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.285674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:38.285674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.285674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:38.285674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.285674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.285674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:38.285674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.285674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:38.286437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.287178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.288003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:38.288003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.288003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:38.288003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:38.288382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:38.288903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.289523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.290357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:38.290357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.290357 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:38.290357 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.290357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.290357 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:38.290357 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.290357 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:38.291813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.292311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:38.292311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.292311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:38.292311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.292311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.292311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:38.292311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.292311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:38.293579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.294026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:38.294535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.294535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:38.452749 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:38.453661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:38.454447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.454889 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:38.455155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.457168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:38.457590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:38.457990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:38.457990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:38.457990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:38.457990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:43.030113 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:43.031784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:43.074479 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:43.074795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:43.076748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:43.077380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.077965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:43.077965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.077965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.077965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:43.077965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.077965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:43.149119 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:43.150229 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:43.150229 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:43.150561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.151176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:43.151176 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.151176 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:43.151176 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.151176 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.151176 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:43.151176 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.151176 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.152380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.153190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:43.281378 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:43.282105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:43.283046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:43.283360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.284265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:43.284265 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.284265 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:43.284265 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.284265 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.284265 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:43.284265 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.284265 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:43.285794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:43.286693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:43.286693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.286693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:43.286693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.286693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.286693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:43.286693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.286693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:43.287389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.288254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.289111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:43.289111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.289111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:43.289111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:43.289111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:43.289475 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:43.289968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.290812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:43.290812 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.290812 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:43.290812 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.290812 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.290812 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:43.290812 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.290812 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:43.292253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:43.292986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:43.292986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.292986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:43.292986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.292986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.292986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:43.292986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.292986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:43.294186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.294652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:43.295230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.295230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:43.453644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:43.455094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:43.455798 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:43.456257 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:43.456508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.457454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:43.457454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.457454 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:43.457454 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.457454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.457454 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:43.457454 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.457454 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.459679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:43.460788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:48.030613 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:48.032294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:48.082159 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:48.082661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.083758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:14:48.083758 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.083758 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:48.083758 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.083758 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.083758 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:48.083758 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.083758 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.085123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.086292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:48.149736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:48.150972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:48.151385 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:48.151646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.152612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:48.152612 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.152612 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:48.152612 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.152612 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.152612 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:48.152612 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.152612 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.154589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.155142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:48.282173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:48.282823 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:48.284002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:48.284459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.285495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:48.285495 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.285495 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:48.285495 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.285495 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.285495 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:48.285495 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.285495 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:48.287138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:48.287944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:48.287944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.287944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:48.287944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.287944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.287944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:48.287944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.287944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:48.288783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.289702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.290843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:48.290843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.290843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:48.290843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:48.290843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:48.290843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:48.291319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.291743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:48.291743 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.291743 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:48.291743 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.291743 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.291743 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:48.291743 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.291743 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:48.292874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:48.293333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:48.293333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.293333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:48.293333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.293333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.293333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:48.293333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.293333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:48.294569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.295498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:48.296372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.296372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:48.455138 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:48.456024 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:48.456656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:48.457122 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:48.457368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.458397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:48.458397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.458397 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:48.458397 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.458397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.458397 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:48.458397 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.458397 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.460036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:48.460923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:53.031486 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:53.033217 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:53.066788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:53.067321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.068329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:14:53.068329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.068329 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:53.068329 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.068329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.068329 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:53.068329 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.068329 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.069503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.069975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:53.150359 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:53.151645 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:53.152058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:53.152305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.153223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:53.153223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.153223 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:53.153223 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.153223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.153223 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:53.153223 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.153223 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.155391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.156490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:53.283035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:53.283733 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:53.284340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:53.284588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.285302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:53.285302 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.285302 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:53.285302 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.285302 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.285302 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:53.285302 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.285302 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:53.286645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:53.287842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:53.287842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.287842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:53.287842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.287842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.287842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:53.287842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.287842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:53.288619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.289114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.289622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:53.289622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.289622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:53.290007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:53.290316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:53.290789 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:53.291048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.291622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:53.291622 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.291622 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:53.291622 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.291622 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.291622 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:53.291622 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.291622 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:53.292785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:53.293285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:53.293285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.293285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:53.293285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.293285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.293285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:53.293285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.293285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:53.293895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.294358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:53.294890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.294890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:53.455980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:53.456760 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:53.457480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:53.457897 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:53.458167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.459061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:53.459061 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.459061 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:53.459061 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.459061 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.459061 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:53.459061 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.459061 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.460843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:53.461728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:58.032319 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:58.033455 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:58.073522 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:58.073780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.074532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:14:58.074532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.074532 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:58.074532 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.074532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.074532 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:58.074532 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.074532 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.076164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.076764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:58.151160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:58.152241 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:58.152506 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:58.152717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.153456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:58.153456 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.153456 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:58.153456 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.153456 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.153456 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:58.153456 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.153456 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.154687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.155276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:58.284131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:58.284580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:14:58.285553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:58.285906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.286982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:58.286982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.286982 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:58.286982 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.286982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.286982 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:58.286982 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.286982 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:58.288486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:58.289391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:58.289391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.289391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:58.289391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.289391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.289391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:58.289391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.289391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:14:58.290550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.291495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.292360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:58.292360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.292360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:58.292360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:58.292360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:58.292360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:58.292571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.293389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:58.293389 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.293389 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:58.293389 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.293389 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.293389 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:58.293389 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.293389 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:14:58.294787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:58.295253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:14:58.295253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.295253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:14:58.295253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.295253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.295253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:14:58.295253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.295253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:14:58.296731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.297191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:58.297667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.297667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:14:58.456840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:14:58.457662 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:14:58.458333 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:58.458812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:14:58.459104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.459902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:14:58.459902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.459902 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:14:58.459902 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.459902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.459902 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:14:58.459902 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.459902 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.461191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:14:58.746764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:03.033111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:03.034840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:03.152107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:03.154658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:03.155231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:03.155517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.156565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:03.156565 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.156565 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:03.156565 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.156565 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.156565 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:03.156565 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.156565 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.158464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.159380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:03.284654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:03.284942 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:03.286133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:03.286498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.287523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:03.287523 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.287523 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:03.287523 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.287523 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.287523 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:03.287523 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.287523 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:03.288988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:03.289737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:03.289737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.289737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:03.289737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.289737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.289737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:03.289737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.289737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:03.290806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.291593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.292476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:03.292476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.292476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:03.292476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:03.292476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:03.293117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:03.293681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.294654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:03.294654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.294654 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:03.294654 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.294654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.294654 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:03.294654 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.294654 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:03.295477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:03.295964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:03.295964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.295964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:03.295964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.295964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.295964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:03.295964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.295964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:03.296578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.297086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:03.297588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.297588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:03.457939 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:03.458719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:03.459648 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:03.459897 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:03.460055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.460672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:03.460672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.460672 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:03.460672 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.460672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.460672 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:03.460672 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.460672 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.461900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.462652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:03.699313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:03.699762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.700792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Traceback (most recent call last):
Mar 19 18:15:03.700792 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.700792 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:03.700792 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.700792 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.700792 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:03.700792 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.700792 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2c2476d5-2534-454c-9144-390f0640485d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.953061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:03.953619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:08.033716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:08.035591 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:08.076033 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:08.076497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.077511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:15:08.077511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.077511 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:08.077511 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.077511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.077511 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:08.077511 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.077511 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.078503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.081424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:08.153018 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:08.154871 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:08.155306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:08.155621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.156859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:08.156859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.156859 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:08.156859 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.156859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.156859 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:08.156859 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.156859 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.158833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.159859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:08.285365 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:08.285656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:08.286816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:08.287397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.288364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:08.288364 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.288364 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:08.288364 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.288364 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.288364 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:08.288364 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.288364 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:08.289714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:08.290549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:08.290549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.290549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:08.290549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.290549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.290549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:08.290549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.290549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:08.291659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.293241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.294373 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:08.295183 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.295183 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:08.296384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.298313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:08.299345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.300246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:08.458569 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:08.459364 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:08.460318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:08.460772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:08.461066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.461979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:08.461979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.461979 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:08.461979 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.461979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.461979 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:08.461979 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.461979 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.463762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:08.465036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:13.034677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:13.036244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:13.073170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:13.073526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.074492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:15:13.074492 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.074492 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:13.074492 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.074492 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.074492 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:13.074492 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.074492 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.076115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.076865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:13.153980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:13.156117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:13.156584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:13.156978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.158196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:13.158196 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.158196 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:13.158196 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.158196 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.158196 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:13.158196 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.158196 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.159568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.160586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:13.286199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:13.286849 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:13.287529 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:13.287990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.288806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:13.288806 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.288806 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:13.288806 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.288806 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.288806 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:13.288806 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.288806 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:13.290128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:13.290998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:13.290998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.290998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:13.290998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.290998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.290998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:13.290998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.290998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:13.291725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.292503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.294066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:13.294066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.294066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:13.294066 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:13.294066 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:13.294066 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:13.294415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.295043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:13.295043 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.295043 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:13.295043 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.295043 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.295043 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:13.295043 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.295043 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:13.296249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:13.296981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:13.296981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.296981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:13.296981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.296981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.296981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:13.296981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.296981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:13.297603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.298078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:13.298610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.298610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:13.459377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:13.460338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:13.465042 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:13.465042 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:13.465042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.465727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:13.465727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.465727 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:13.465727 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.465727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.465727 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:13.465727 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.465727 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.466813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:13.468075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:18.035400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:18.037226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:18.077603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:18.077796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.078348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:15:18.078348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.078348 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:18.078348 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.078348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.078348 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:18.078348 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.078348 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.079150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.079936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:18.155055 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:18.156338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:18.156550 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:18.156977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.157377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:18.157377 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.157377 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:18.157377 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.157377 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.157377 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:18.157377 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.157377 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.158542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.159385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:18.287060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:18.287443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:18.288523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:18.288996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.289943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:18.289943 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.289943 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:18.289943 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.289943 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.289943 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:18.289943 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.289943 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:18.291280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:18.291986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:18.291986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.291986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:18.291986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.291986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.291986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:18.291986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.291986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:18.292918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.293653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.294495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:18.294495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.294495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:18.294495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:18.294495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:18.294495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:18.294812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.295535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:18.295535 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.295535 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:18.295535 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.295535 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.295535 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:18.295535 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.295535 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:18.296691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:18.297256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:18.297256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.297256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:18.297256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.297256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.297256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:18.297256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.297256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:18.298477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.298989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:18.299523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.299523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:18.460126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:18.460952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:18.461870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:18.462429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:18.462758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.463773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:18.463773 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.463773 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:18.463773 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.463773 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.463773 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:18.463773 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.463773 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.465835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:18.466973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:23.036139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:23.037752 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:23.083154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:23.083485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.084306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:15:23.084306 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.084306 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:23.084306 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.084306 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.084306 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:23.084306 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.084306 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.087037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.087662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:23.156055 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:23.157733 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:23.158062 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:23.158308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.159243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:23.159243 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.159243 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:23.159243 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.159243 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.159243 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:23.159243 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.159243 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.161007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.161622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:23.287806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:23.288449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:23.289003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:23.289333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.290447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:23.290447 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.290447 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:23.290447 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.290447 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.290447 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:23.290447 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.290447 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:23.292318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:23.293148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:23.293148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.293148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:23.293148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.293148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.293148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:23.293148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.293148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:23.294092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.294949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.296003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:23.296003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.296003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:23.296003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:23.296003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:23.296003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:23.296003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.296554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:23.296554 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.296554 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:23.296554 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.296554 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.296554 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:23.296554 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.296554 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:23.297703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:23.298753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:23.298753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.298753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:23.298753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.298753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.298753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:23.298753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.298753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:23.299265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.300122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:23.301305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.301305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:23.460780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:23.461509 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:23.462573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:23.463051 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:23.463393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.464321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:23.464321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.464321 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:23.464321 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.464321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.464321 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:23.464321 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.464321 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.465629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:23.466181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:28.039774 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:28.041643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:28.076661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:28.076661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.077309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:15:28.077309 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.077309 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:28.077309 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.077309 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.077309 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:28.077309 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.077309 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.078494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.079473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:28.156860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:28.158400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:28.158699 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:28.158953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.159771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:28.159771 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.159771 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:28.159771 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.159771 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.159771 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:28.159771 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.159771 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.161401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.161942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:28.288627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:28.289127 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:28.290194 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:28.290500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.291460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:28.291460 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.291460 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:28.291460 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.291460 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.291460 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:28.291460 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.291460 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:28.292898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:28.293686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:28.293686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.293686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:28.293686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.293686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.293686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:28.293686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.293686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:28.294680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.295995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.296848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:28.296848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.296848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:28.296848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:28.296848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:28.296848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:28.296848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.297489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:28.297489 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.297489 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:28.297489 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.297489 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.297489 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:28.297489 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.297489 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:28.298971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:28.299584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:28.299584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.299584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:28.299584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.299584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.299584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:28.299584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.299584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:28.300614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.301248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:28.301805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.301805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:28.461631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:28.462610 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:28.463434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:28.463844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:28.464181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.465191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:28.465191 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.465191 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:28.465191 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.465191 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.465191 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:28.465191 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.465191 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.467374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:28.468534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:33.040461 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:33.041643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:33.043704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=324,neutron:UPDATE=1 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:15:33.113604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:33.114138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.115986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:15:33.115986 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.115986 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:33.115986 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.115986 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.115986 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:33.115986 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.115986 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.117159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.118233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:33.157737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:33.160041 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:33.160526 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:33.160834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.162481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:33.162481 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.162481 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:33.162481 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.162481 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.162481 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:33.162481 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.162481 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.165760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.166862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:33.289477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:33.290275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:33.291136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:33.291671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.292748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:33.292748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.292748 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:33.292748 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.292748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.292748 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:33.292748 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.292748 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:33.294236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:33.295011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:33.295011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.295011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:33.295011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.295011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.295011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:33.295011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.295011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:33.295980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.297424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.301098 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:33.301600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.302130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:33.302712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.303231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:33.303779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.303779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:33.462367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:33.463013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:33.463960 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:33.464475 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:33.464801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.465671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:33.465671 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.465671 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:33.465671 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.465671 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.465671 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:33.465671 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.465671 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:33.467474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:38.041227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:38.043833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:38.086146 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:38.086146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.086454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:15:38.086454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.086454 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:38.086454 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.086454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.086454 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:38.086454 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.086454 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.087268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.088102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:38.158898 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:38.160399 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:38.160841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:38.161135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.162131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:38.162131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.162131 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:38.162131 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.162131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.162131 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:38.162131 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.162131 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.163422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.164106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:38.290433 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:38.291108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:38.291693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:38.292082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.292873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:38.292873 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.292873 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:38.292873 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.292873 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.292873 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:38.292873 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.292873 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:38.296078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.296670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:38.297392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:38.297952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:38.298413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:38.301367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.302205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:38.303043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.303787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:38.304562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.304562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:38.464320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:38.464618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:38.465518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:38.466020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:38.466273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.467133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:38.467133 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.467133 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:38.467133 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.467133 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.467133 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:38.467133 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.467133 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.471846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:38.472661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:43.042073 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:43.045800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:43.079652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:43.080165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.080994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:15:43.080994 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.080994 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:43.080994 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.080994 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.080994 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:43.080994 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.080994 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.082486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.083088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:43.159794 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:43.162557 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:43.162557 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:43.162557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.163010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:43.163010 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.163010 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:43.163010 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.163010 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.163010 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:43.163010 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.163010 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.164665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.166402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:43.291285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:43.292449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:43.294095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:43.294095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.294486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:43.294486 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.294486 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:43.294486 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.294486 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.294486 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:43.294486 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.294486 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:43.297871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.299230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:43.299969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:43.300358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:43.301675 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:43.301675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.301941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:43.301941 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.301941 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:43.301941 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.301941 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.301941 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:43.301941 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.301941 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:43.303270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:43.303636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:43.303636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.303636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:43.303636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.303636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.303636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:43.303636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.303636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:43.304966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.305310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:43.305674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.305674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:43.465164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:43.465718 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:43.468829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:43.468829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:43.468829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.469171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:43.469171 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.469171 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:43.469171 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.469171 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.469171 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:43.469171 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.469171 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.471576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:43.472752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:48.043696 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:48.047482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:48.080972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:48.081623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.082184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:15:48.082184 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.082184 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:48.082184 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.082184 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.082184 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:48.082184 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.082184 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.084699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:48.161112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:48.164346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:48.164346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:48.164346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.164926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:48.164926 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.164926 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:48.164926 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.164926 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.164926 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:48.164926 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.164926 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.166091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.167239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:48.292366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:48.293167 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:48.294000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:48.294591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.295677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:48.295677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.295677 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:48.295677 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.295677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.295677 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:48.295677 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.295677 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:48.299188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.299910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:48.300524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.301270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:48.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:48.303482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:48.304277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:48.304277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.304481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:48.304481 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.304481 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:48.304481 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.304481 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.304481 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:48.304481 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.304481 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:48.305448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:48.306155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:48.306155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.306155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:48.306155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.306155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.306155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:48.306155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.306155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:48.306527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.306831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:48.307177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.307177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:48.466006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:48.466830 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:48.468502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:48.468502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:48.468502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.468768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:48.468768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.468768 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:48.468768 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.468768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.468768 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:48.468768 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.468768 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.471045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:48.471614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:53.045127 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:53.047043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:53.080552 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:53.080723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.081333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:15:53.081333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.081333 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:53.081333 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.081333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.081333 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:53.081333 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.081333 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.082352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.082981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:53.171674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:53.173025 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:53.173275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:53.173503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.174462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:53.174462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.174462 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:53.174462 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.174462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.174462 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:53.174462 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.174462 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.176074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.177065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:53.293522 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:53.293941 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:53.294664 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:53.295081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.295974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:53.295974 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.295974 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:53.295974 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.295974 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.295974 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:53.295974 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.295974 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:53.297240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:53.298091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:53.298091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.298091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:53.298091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.298091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.298091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:53.298091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.298091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:53.298732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.299469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.300309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:53.300309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.300309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:53.303253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:53.303826 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:53.304255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:53.304425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.304956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:53.304956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.304956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:53.304956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.304956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.304956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:53.304956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.304956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:53.306414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:53.306886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:53.306886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.306886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:53.306886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.306886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.306886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:53.306886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.306886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:53.308256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.308708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:53.309247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.309247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:53.466725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:53.467478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:53.468242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:53.468649 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:53.468905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.469864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:53.469864 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.469864 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:53.469864 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.469864 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.469864 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:53.469864 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.469864 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.471897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:53.472681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:58.046192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:58.048530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:58.088714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:58.089261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.090329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:15:58.090329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.090329 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:58.090329 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.090329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.090329 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:58.090329 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.090329 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.091352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.092293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:58.172589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:58.197646 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:58.198173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:58.198537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.200342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:58.200342 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.200342 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:58.200342 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.200342 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.200342 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:58.200342 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.200342 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.201668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.202523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:58.294404 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:58.294735 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:15:58.295805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:58.296251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.297542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:58.297542 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.297542 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:58.297542 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.297542 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.297542 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:58.297542 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.297542 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:58.299006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:58.300117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:58.300117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.300117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:58.300117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.300117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.300117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:58.300117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.300117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:15:58.300671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.301614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.302941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:58.302941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.302941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:58.303704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:58.304415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:58.305394 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:58.305910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.307040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:58.307040 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.307040 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:58.307040 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.307040 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.307040 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:58.307040 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.307040 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:15:58.308589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:58.308946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:15:58.308946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.308946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:15:58.308946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.308946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.308946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:15:58.308946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.308946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:15:58.310075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.310400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:58.310742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.310742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:15:58.467990 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:15:58.468664 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:15:58.469693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:58.470188 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:15:58.470492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.471548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:15:58.471548 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.471548 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:15:58.471548 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.471548 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.471548 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:15:58.471548 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.471548 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.473440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:15:58.474308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:03.047306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:03.049039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:03.083894 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:03.084261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.085078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:03.085078 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.085078 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:03.085078 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.085078 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.085078 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:03.085078 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.085078 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.086337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.086982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:03.173358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:03.175237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:03.175551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:03.175737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.176689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:03.176689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.176689 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:03.176689 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.176689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.176689 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:03.176689 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.176689 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.178206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.179773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:03.295104 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:03.295457 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:03.296507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:03.296966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.298229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:03.298229 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.298229 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:03.298229 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.298229 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.298229 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:03.298229 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.298229 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:03.299935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:03.300806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:03.300806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.300806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:03.300806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.300806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.300806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:03.300806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.300806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:03.302300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.304164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.304918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:03.304918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.304918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:03.304918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:03.304918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:03.305236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:03.305868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:03.309574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.310128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:03.310612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.311099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:03.468942 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:03.470310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:03.471249 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:03.471695 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:03.471976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.472999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:03.472999 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.472999 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:03.472999 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.472999 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.472999 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:03.472999 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.472999 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.474350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:03.475236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:08.048136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:08.050373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:08.095045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:08.095220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.095829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:08.095829 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.095829 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:08.095829 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.095829 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.095829 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:08.095829 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.095829 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.096848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.097695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:08.174245 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:08.175788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:08.176306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:08.176805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.177739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:08.177739 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.177739 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:08.177739 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.177739 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.177739 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:08.177739 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.177739 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.180043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.181281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:08.295898 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:08.296770 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:08.297353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:08.297753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:08.302178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.303085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:08.304062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.304797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.305690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:08.305690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.305690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:08.306237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:08.306868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:08.307514 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:08.307868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:08.309889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.310303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:08.310581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:08.470501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:08.470994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:08.471715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:08.472241 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:08.472551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.473465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:08.473465 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.473465 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:08.473465 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.473465 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.473465 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:08.473465 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.473465 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.475120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:08.476406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:13.049012 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:13.050170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:13.083271 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:13.083438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.083934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:13.083934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.083934 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:13.083934 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.083934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.083934 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:13.083934 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.083934 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.084794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.085617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:13.174838 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:13.175977 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:13.176275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:13.176559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.177311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:13.177311 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.177311 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:13.177311 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.177311 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.177311 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:13.177311 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.177311 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.178828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.179508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:13.296682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:13.297416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:13.298129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:13.298472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.299434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:13.299434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.299434 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:13.299434 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.299434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.299434 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:13.299434 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.299434 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:13.300866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:13.301230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:13.301230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.301230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:13.301230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.301230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.301230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:13.301230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.301230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:13.302553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.302861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.303233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:13.303233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.303233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:13.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:13.307285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:13.307790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:13.308202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.309082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:13.309082 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.309082 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:13.309082 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.309082 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.309082 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:13.309082 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.309082 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:13.310333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:13.312050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.313191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:13.314464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.314464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:13.471361 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:13.472037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:13.473035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:13.473251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:13.473420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.474084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:13.474084 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.474084 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:13.474084 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.474084 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.474084 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:13.474084 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.474084 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.475768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:13.476158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:18.049816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:18.051367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:18.096751 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:18.097275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.098434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:18.098434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.098434 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:18.098434 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.098434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.098434 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:18.098434 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.098434 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.100151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.101275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:18.175691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:18.177445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:18.177868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:18.178190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.179128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:18.179128 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.179128 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:18.179128 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.179128 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.179128 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:18.179128 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.179128 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.180734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.181571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:18.297560 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:18.298380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:18.299563 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:18.300094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.301083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:18.301083 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.301083 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:18.301083 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.301083 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.301083 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:18.301083 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.301083 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:18.302168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:18.302976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:18.302976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.302976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:18.302976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.302976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.302976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:18.302976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.302976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:18.303398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.304186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.305205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:18.305205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.305205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:18.307430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:18.308087 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:18.308634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:18.308926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.309563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:18.309563 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.309563 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:18.309563 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.309563 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.309563 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:18.309563 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.309563 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:18.310564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:18.311019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:18.311019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.311019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:18.311019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.311019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.311019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:18.311019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.311019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:18.311868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.313675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:18.315255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.315255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:18.472303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:18.473187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:18.474352 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:18.474919 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:18.475238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.476251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:18.476251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.476251 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:18.476251 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.476251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.476251 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:18.476251 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.476251 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.477411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:18.478221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:23.050617 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:23.052148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:23.091471 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:23.091805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.092540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:23.092540 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.092540 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:23.092540 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.092540 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.092540 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:23.092540 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.092540 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.093496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.094364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:23.176706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:23.178393 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:23.178807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:23.179102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.180127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:23.180127 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.180127 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:23.180127 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.180127 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.180127 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:23.180127 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.180127 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.182837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.183674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:23.298689 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:23.299930 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:23.300734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:23.301075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.301975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:23.301975 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.301975 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:23.301975 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.301975 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.301975 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:23.301975 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.301975 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:23.304099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.304639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:23.305004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.305378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:23.308076 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:23.316149 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:23.316953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:23.317474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.318915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:23.318915 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.318915 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:23.318915 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.318915 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.318915 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:23.318915 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.318915 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:23.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:23.321448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:23.321448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.321448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:23.321448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.321448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.321448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:23.321448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.321448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:23.326188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.326965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:23.327306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.327306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:23.473419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:23.474035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:23.474905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:23.475382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:23.475637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.476663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:23.476663 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.476663 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:23.476663 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.476663 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.476663 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:23.476663 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.476663 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.478602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:23.479556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:28.051288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:28.053124 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:28.090281 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:28.090786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.092137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:28.092137 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.092137 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:28.092137 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.092137 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.092137 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:28.092137 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.092137 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.093491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.094304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:28.177747 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:28.179237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:28.179564 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:28.179751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.181126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:28.181126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.181126 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:28.181126 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.181126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.181126 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:28.181126 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.181126 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.181952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.182703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:28.300056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:28.300726 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:28.301862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:28.302319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.303320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:28.303320 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.303320 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:28.303320 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.303320 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.303320 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:28.303320 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.303320 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:28.304693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:28.305513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:28.305513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.305513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:28.305513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.305513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.305513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:28.305513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.305513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:28.306229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.307178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.308054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:28.308054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.308054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:28.316117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:28.316868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:28.317384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:28.317792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.318690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:28.318690 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.318690 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:28.318690 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.318690 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.318690 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:28.318690 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.318690 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:28.321115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.321870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:28.322643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.323606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:28.474197 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:28.474872 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:28.475801 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:28.476263 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:28.476523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.477569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:28.477569 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.477569 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:28.477569 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.477569 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.477569 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:28.477569 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.477569 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.478814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:28.479525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:33.052250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:33.054174 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:33.095715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=258 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:16:33.100173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:33.100805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.102019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:33.102019 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.102019 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:33.102019 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.102019 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.102019 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:33.102019 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.102019 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.103530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.105036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:33.178654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:33.180535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:33.181126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:33.181308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.182194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:33.182194 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.182194 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:33.182194 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.182194 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.182194 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:33.182194 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.182194 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.183864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.184501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:33.300674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:33.301540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:33.302432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:33.302768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.303723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:33.303723 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.303723 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:33.303723 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.303723 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.303723 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:33.303723 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.303723 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:33.305237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:33.306198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:33.306198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.306198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:33.306198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.306198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.306198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:33.306198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.306198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:33.306632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.307376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.308206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:33.308206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.308206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:33.316838 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:33.317771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:33.318418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:33.318755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.319555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:33.319555 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.319555 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:33.319555 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.319555 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.319555 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:33.319555 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.319555 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:33.320509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:33.321467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:33.321467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.321467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:33.321467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.321467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.321467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:33.321467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.321467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:33.321846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.323520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:33.325208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.325208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:33.474930 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:33.475446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:33.475995 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:33.476408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:33.476653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.477531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:33.477531 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.477531 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:33.477531 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.477531 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.477531 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:33.477531 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.477531 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.479298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:33.480197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:38.053537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:38.057180 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:38.091733 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:38.092140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.092996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:38.092996 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.092996 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:38.092996 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.092996 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.092996 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:38.092996 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.092996 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.094465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.095074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:38.179553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:38.181258 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:38.182745 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:38.182745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.183082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:38.183082 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.183082 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:38.183082 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.183082 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.183082 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:38.183082 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.183082 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.184981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.185480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:38.301568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:38.301999 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:38.303658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:38.303658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.303833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:38.303833 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.303833 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:38.303833 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.303833 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.303833 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:38.303833 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.303833 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:38.305375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:38.305749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:38.305749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.305749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:38.305749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.305749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.305749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:38.305749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.305749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:38.307071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.307437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.307787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:38.307787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.307787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:38.317620 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:38.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:38.320219 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:38.320219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.320589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:38.320589 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.320589 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:38.320589 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.320589 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.320589 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:38.320589 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.320589 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:38.322723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:38.323581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:38.323581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.323581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:38.323581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.323581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.323581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:38.323581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.323581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:38.327491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.328492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:38.329469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.329469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:38.475926 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:38.476442 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:38.477197 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:38.477518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:38.477705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.478395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:38.478395 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.478395 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:38.478395 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.478395 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.478395 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:38.478395 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.478395 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.479712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:38.480746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:43.055299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:43.057279 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:43.094845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:43.095341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.096331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:43.096331 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.096331 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:43.096331 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.096331 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.096331 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:43.096331 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.096331 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.097579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.098454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:43.180413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:43.181915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:43.182198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:43.182367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.183341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:43.183341 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.183341 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:43.183341 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.183341 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.183341 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:43.183341 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.183341 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.186224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.187422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:43.302415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:43.303115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:43.304130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:43.304672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.305853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:43.305853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.305853 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:43.305853 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.305853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.305853 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:43.305853 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.305853 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:43.306572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:43.307158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:43.307158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.307158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:43.307158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.307158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.307158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:43.307158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.307158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:43.308123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.308591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.309171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:43.309171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.309171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:43.318264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:43.319021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:43.320010 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:43.320010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.320442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:43.320442 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.320442 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:43.320442 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.320442 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.320442 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:43.320442 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.320442 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:43.321422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:43.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:43.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:43.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:43.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:43.322745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.323667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:43.324669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.324669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:43.476642 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:43.477215 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:43.478150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:43.478840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:43.478840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.479840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:43.479840 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.479840 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:43.479840 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.479840 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.479840 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:43.479840 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.479840 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.481577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:43.482433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:48.056153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:48.057976 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:48.093682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:48.093682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.094354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:48.094354 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.094354 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:48.094354 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.094354 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.094354 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:48.094354 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.094354 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.095407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.096194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:48.181190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:48.183079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:48.183550 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:48.183869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.185046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:48.185046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.185046 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:48.185046 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.185046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.185046 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:48.185046 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.185046 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.187133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.188001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:48.303228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:48.304094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:48.305005 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:48.305363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.306261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:48.306261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.306261 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:48.306261 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.306261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.306261 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:48.306261 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.306261 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:48.307519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:48.308033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:48.308033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.308033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:48.308033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.308033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.308033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:48.308033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.308033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:48.308757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.309208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.309756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:48.309756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.309756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:48.318830 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:48.319272 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:48.319776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:48.320050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.320656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:48.320656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.320656 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:48.320656 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.320656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.320656 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:48.320656 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.320656 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:48.321850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:48.322607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:48.322607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.322607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:48.322607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.322607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.322607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:48.322607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.322607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:48.323340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.324100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:48.325007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.325007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:48.477429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:48.478238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:48.478714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:48.479075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:48.479250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.479902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:48.479902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.479902 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:48.479902 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.479902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.479902 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:48.479902 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.479902 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.480898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:48.481593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:53.057150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:53.060316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:53.101541 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:53.102008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.103091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:53.103091 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.103091 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:53.103091 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.103091 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.103091 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:53.103091 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.103091 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.104463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.104954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:53.182255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:53.184292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:53.184708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:53.185078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.186264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:53.186264 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.186264 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:53.186264 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.186264 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.186264 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:53.186264 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.186264 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.188746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.189636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:53.304194 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:53.304838 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:53.305868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:53.306295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.307427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:53.307427 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.307427 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:53.307427 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.307427 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.307427 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:53.307427 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.307427 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:53.308834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:53.309601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:53.309601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.309601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:53.309601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.309601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.309601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:53.309601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.309601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:53.310584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.311384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.312341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:53.312341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.312341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:53.319476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:53.320745 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:53.321458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:53.322043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.323356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:53.323356 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.323356 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:53.323356 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.323356 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.323356 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:53.323356 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.323356 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:53.324546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:53.325281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:53.325281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.325281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:53.325281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.325281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.325281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:53.325281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.325281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:53.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.327116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:53.327693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.327693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:53.478341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.498812 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.499704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:53.500551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:58.057746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:58.059691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:58.103044 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:58.103549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.104619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:16:58.104619 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.104619 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:58.104619 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.104619 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.104619 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:58.104619 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.104619 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.105585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.106430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:58.182986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:58.184770 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:58.185353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:58.185353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.185982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:58.185982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.185982 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:58.185982 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.185982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.185982 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:58.185982 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.185982 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.188031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.188761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:58.304835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:58.305299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:16:58.306385 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:58.306792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.307803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:58.307803 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.307803 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:58.307803 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.307803 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.307803 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:58.307803 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.307803 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:58.309204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:58.309961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:58.309961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.309961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:58.309961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.309961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.309961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:58.309961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.309961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:16:58.310785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.311530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.312399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:58.312399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.312399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:58.320361 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:58.320644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:58.321211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:58.321571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.322411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:58.322411 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.322411 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:58.322411 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.322411 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.322411 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:58.322411 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.322411 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:16:58.323232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:58.323687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:16:58.323687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.323687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:16:58.323687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.323687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.323687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:16:58.323687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.323687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:16:58.324866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.325323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:58.325817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.325817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:16:58.493843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:16:58.494819 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:16:58.497422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:58.500671 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:16:58.500671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.501696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:16:58.501696 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.501696 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:16:58.501696 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.501696 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.501696 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:16:58.501696 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.501696 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.503337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:16:58.504112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:03.058600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:03.060547 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:03.100058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:03.100422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:03.101308 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.101308 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:03.101308 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.101308 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.101308 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:03.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.102615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.115765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:03.183975 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:03.186139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:03.186594 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:03.186594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.189173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:03.189173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.189173 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:03.189173 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.189173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.189173 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:03.189173 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.189173 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.190371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.191122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:03.305721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:03.306122 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:03.307064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:03.307407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.308367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:03.308367 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.308367 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:03.308367 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.308367 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.308367 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:03.308367 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.308367 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:03.309808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:03.310628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:03.310628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.310628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:03.310628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.310628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.310628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:03.310628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.310628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:03.311484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.313044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.317680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:03.317680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.317680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:03.321133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:03.321894 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:03.322484 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:03.322753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.323434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:03.323434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.323434 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:03.323434 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.323434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.323434 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:03.323434 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.323434 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:03.324833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.326604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:03.328035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.329866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:03.494622 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:03.495410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:03.496572 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:03.497111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:03.497363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.498409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:03.498409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.498409 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:03.498409 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.498409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.498409 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:03.498409 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.498409 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.500352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:03.501442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:08.059468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:08.061209 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:08.099528 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:08.100063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.101104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:08.101104 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.101104 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:08.101104 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.101104 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.101104 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:08.101104 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.101104 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.102131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.102698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:08.184906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:08.186644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:08.187057 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:08.187298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.188294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:08.188294 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.188294 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:08.188294 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.188294 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.188294 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:08.188294 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.188294 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.189865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.190713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:08.306611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:08.307006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:08.307914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:08.308336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.309304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:08.309304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.309304 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:08.309304 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.309304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.309304 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:08.309304 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.309304 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:08.310626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:08.311605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:08.311605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.311605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:08.311605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.311605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.311605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:08.311605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.311605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:08.312495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.313184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.313699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:08.313699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.313699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:08.322087 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:08.322981 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:08.323809 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:08.324524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.325344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:08.325344 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.325344 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:08.325344 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.325344 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.325344 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:08.325344 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.325344 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:08.326495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:08.327028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:08.327028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.327028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:08.327028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.327028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.327028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:08.327028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.327028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:08.327645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.328171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:08.328663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.328663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:08.495392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:08.496154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:08.497098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:08.497540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:08.497796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.498728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:08.498728 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.498728 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:08.498728 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.498728 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.498728 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:08.498728 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.498728 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.500661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:08.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:13.060332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:13.061929 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:13.096373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:13.096766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.097787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:13.097787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.097787 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:13.097787 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.097787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.097787 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:13.097787 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.097787 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.098739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.099613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:13.185656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:13.187338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:13.187918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:13.187918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.188822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:13.188822 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.188822 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:13.188822 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.188822 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.188822 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:13.188822 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.188822 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.190473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.191461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:13.307249 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:13.307942 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:13.308419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:13.308862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:13.310908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.311324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.311631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.312613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:13.322526 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:13.323347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:13.324039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:13.324332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.324956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:13.324956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.324956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:13.324956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.324956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.324956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:13.324956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.324956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:13.326454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:13.326759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:13.326759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.326759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:13.326759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.326759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.326759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:13.326759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.326759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:13.328539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.329175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:13.330161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.330161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:13.496000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:13.496708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:13.497473 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:13.497970 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:13.498272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.499259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:13.499259 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.499259 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:13.499259 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.499259 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.499259 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:13.499259 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.499259 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.501256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:13.502158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:18.061346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:18.063248 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:18.099497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:18.100023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.101057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:18.101057 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.101057 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:18.101057 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.101057 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.101057 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:18.101057 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.101057 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.102238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.103743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:18.186422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:18.188191 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:18.188492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:18.188717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.189764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:18.189764 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.189764 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:18.189764 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.189764 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.189764 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:18.189764 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.189764 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.191825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.192910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:18.308088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:18.308911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:18.309976 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:18.310350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.311299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:18.311299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.311299 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:18.311299 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.311299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.311299 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:18.311299 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.311299 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:18.312825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:18.313618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:18.313618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.313618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:18.313618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.313618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.313618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:18.313618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.313618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:18.314455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.315315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.315930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:18.315930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.315930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:18.323204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:18.323894 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:18.324422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:18.324691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.325468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:18.325468 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.325468 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:18.325468 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.325468 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.325468 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:18.325468 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.325468 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:18.327064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:18.327517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:18.327517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.327517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:18.327517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.327517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.327517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:18.327517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.327517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:18.328915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.329378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:18.329902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.329902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:18.497061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:18.497989 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:18.498928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:18.499311 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:18.499529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.500453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:18.500453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.500453 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:18.500453 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.500453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.500453 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:18.500453 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.500453 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.503160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:18.503981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:23.062148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:23.064499 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:23.103089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:23.103546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.104591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:23.104591 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.104591 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:23.104591 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.104591 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.104591 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:23.104591 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.104591 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.105703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.106611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:23.187463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:23.188935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:23.189400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:23.190053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.191164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:23.191164 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.191164 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:23.191164 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.191164 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.191164 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:23.191164 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.191164 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.193402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.194498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:23.308928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:23.309538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:23.310443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:23.310915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.312681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:23.312681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.312681 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:23.312681 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.312681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.312681 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:23.312681 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.312681 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:23.314470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:23.315103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:23.315103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.315103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:23.315103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.315103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.315103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:23.315103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.315103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:23.316323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.317007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.317695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:23.317695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.317695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:23.323775 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:23.324335 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:23.324950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:23.325231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.326022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:23.326022 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.326022 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:23.326022 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.326022 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.326022 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:23.326022 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.326022 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:23.327507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:23.328206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:23.328206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.328206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:23.328206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.328206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.328206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:23.328206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.328206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:23.329339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.330421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:23.330933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.330933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:23.497944 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:23.498707 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:23.499608 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:23.500050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:23.500292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.501220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:23.501220 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.501220 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:23.501220 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.501220 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.501220 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:23.501220 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.501220 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.502916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:23.503854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:28.062832 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:28.064000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:28.101590 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:28.101590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.102773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:28.102773 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.102773 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:28.102773 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.102773 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.102773 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:28.102773 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.102773 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.104137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:28.188284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:28.190100 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:28.190480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:28.190722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.191801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:28.191801 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.191801 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:28.191801 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.191801 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.191801 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:28.191801 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.191801 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.193160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.193664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:28.309864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:28.310542 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:28.311650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:28.312098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.313473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:28.313473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.313473 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:28.313473 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.313473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.313473 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:28.313473 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.313473 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:28.315231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:28.316162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:28.316162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.316162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:28.316162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.316162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.316162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:28.316162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.316162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:28.317073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.317924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.318701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:28.318701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.318701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:28.324414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:28.324843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:28.325900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:28.326425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.327532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:28.327532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.327532 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:28.327532 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.327532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.327532 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:28.327532 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.327532 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:28.328994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:28.329776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:28.329776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.329776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:28.329776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.329776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.329776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:28.329776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.329776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:28.330240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.331059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:28.331910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.331910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:28.498725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:28.499187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:28.500416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:28.501080 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:28.501425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.502627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:28.502627 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.502627 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:28.502627 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.502627 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.502627 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:28.502627 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.502627 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.504524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:28.505448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:33.063769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:33.065629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:33.105823 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=238 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:17:33.114375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:33.114769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.115724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:33.115724 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.115724 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:33.115724 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.115724 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.115724 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:33.115724 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.115724 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.117138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.118160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:33.189179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:33.190969 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:33.191353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:33.191609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.192821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:33.192821 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.192821 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:33.192821 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.192821 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.192821 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:33.192821 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.192821 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.195721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.196950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:33.310365 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:33.311104 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:33.312220 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:33.312593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.313681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:33.313681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.313681 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:33.313681 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.313681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.313681 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:33.313681 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.313681 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:33.315278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:33.315778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:33.315778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.315778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:33.315778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.315778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.315778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:33.315778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.315778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:33.317021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.317465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.317969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:33.317969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.317969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:33.324960 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:33.325413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:33.325919 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:33.326252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:33.326982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.326982 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:33.326982 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.326982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.326982 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:33.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:33.328265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:33.328721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:33.328721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.328721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:33.328721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.328721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.328721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:33.328721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.328721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:33.330074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.330560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:33.331264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.331264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:33.499419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:33.500203 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:33.501033 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:33.501423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:33.501580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.502355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:33.502355 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.502355 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:33.502355 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.502355 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.502355 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:33.502355 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.502355 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.504280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:33.505177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:38.064503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:38.066078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:38.103750 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:38.104309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.105495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:38.105495 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.105495 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:38.105495 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.105495 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.105495 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:38.105495 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.105495 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.107075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:38.190297 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:38.191799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:38.192280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:38.192545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.193699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:38.193699 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.193699 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:38.193699 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.193699 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.193699 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:38.193699 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.193699 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.196052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.196916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:38.311502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:38.311962 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:38.312972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:38.313230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.314369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:38.314369 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.314369 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:38.314369 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.314369 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.314369 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:38.314369 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.314369 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:38.315705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:38.316660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:38.316660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.316660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:38.316660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.316660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.316660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:38.316660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.316660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:38.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.318554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.319709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:38.319709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.319709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:38.325426 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:38.326237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:38.326816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:38.327223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.327934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:38.327934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.327934 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:38.327934 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.327934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.327934 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:38.327934 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.327934 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:38.329068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:38.329812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:38.329812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.329812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:38.329812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.329812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.329812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:38.329812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.329812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:38.330292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.331283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:38.332363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.332363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:38.500164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:38.500640 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:38.501186 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:38.501580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:38.501858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.502681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:38.502681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.502681 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:38.502681 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.502681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.502681 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:38.502681 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.502681 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.504361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:38.505138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:43.065268 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:43.067388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:43.259827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:43.266284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:43.266578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:43.266836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.268261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:43.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:43.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:43.268261 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.268261 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.272511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.273520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:43.303950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:43.304497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.305558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:17:43.305558 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.305558 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:43.305558 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.305558 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.305558 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:43.305558 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.305558 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.306524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.307431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:43.311701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:43.312002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:43.312317 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:43.312500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.313030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:43.313030 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.313030 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:43.313030 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.313030 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.313030 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:43.313030 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.313030 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:43.313953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:43.314583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:43.314583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.314583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:43.314583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.314583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.314583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:43.314583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.314583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:43.315816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.316474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.317183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:43.317183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.317183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:43.326217 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:43.326638 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:43.327294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:43.327760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.328645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:43.328645 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.328645 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:43.328645 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.328645 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.328645 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:43.328645 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.328645 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:43.329948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:43.330409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:43.330409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.330409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:43.330409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.330409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.330409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:43.330409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.330409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:43.331848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.332306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:43.332810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.332810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:43.500862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:43.501692 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:43.502368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:43.502792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:43.503112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.504073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:43.504073 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.504073 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:43.504073 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.504073 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.504073 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:43.504073 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.504073 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.505419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:43.505959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:48.066287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:48.068498 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:48.103809 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:48.104428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.105687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:17:48.105687 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.105687 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:48.105687 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.105687 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.105687 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:48.105687 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.105687 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.106870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.107685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:48.260792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:48.263005 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:48.263442 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:48.263704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.264901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:17:48.264901 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.264901 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:48.264901 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.264901 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.264901 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:48.264901 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.264901 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:48.267180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.268018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:48.312171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:48.312463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:48.313505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:48.313916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.314897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:48.314897 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.314897 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:48.314897 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.314897 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.314897 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:48.314897 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.314897 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:48.316155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:48.317407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:48.317407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.317407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:48.317407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.317407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.317407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:48.317407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.317407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:48.317778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.318379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.318875 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:48.318875 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.318875 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:48.326643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:48.327315 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:48.327916 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:48.328158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.328762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:48.328762 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.328762 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:48.328762 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.328762 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.328762 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:48.328762 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.328762 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:48.330186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:48.330722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:48.330722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.330722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:48.330722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.330722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.330722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:48.330722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.330722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:48.331813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.332323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:48.332817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.332817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:48.501731 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:48.502263 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:48.503265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:48.503701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:48.503966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.504998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:48.504998 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.504998 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:48.504998 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.504998 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.504998 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:48.504998 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.504998 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.506922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:48.507721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:53.067334 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:53.068190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:53.098326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:53.098668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.099502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:17:53.099502 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.099502 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:53.099502 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.099502 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.099502 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:53.099502 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.099502 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.100302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.100643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:53.261585 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:53.263681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:53.264264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:53.264528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.266005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:53.266005 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.266005 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:53.266005 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.266005 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.266005 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:53.266005 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.266005 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.268076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.268906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:53.312999 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:53.313242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:53.313859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:53.314224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.315114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:53.315114 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.315114 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:53.315114 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.315114 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.315114 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:53.315114 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.315114 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:53.316062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:53.317066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:53.317066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.317066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:53.317066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.317066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.317066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:53.317066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.317066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:53.317530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.318291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.319725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:53.319725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.319725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:53.327109 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:53.327652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:53.328178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:53.328520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.329190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:53.329190 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.329190 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:53.329190 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.329190 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.329190 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:53.329190 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.329190 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:53.330132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:53.330590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:53.330590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.330590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:53.330590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.330590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.330590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:53.330590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.330590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:53.332231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.333051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:53.333816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.333816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:53.502629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:53.503193 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:53.504188 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:53.504591 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:53.504833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.505918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:53.505918 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.505918 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:53.505918 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.505918 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.505918 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:53.505918 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.505918 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.507658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:53.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:58.068202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:58.069576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:58.111597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:58.112061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.113168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:17:58.113168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.113168 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:58.113168 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.113168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.113168 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:58.113168 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.113168 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.115198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.116313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:58.262503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:58.265193 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:58.265480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:58.265617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.267217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:17:58.267217 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.267217 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:58.267217 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.267217 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.267217 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:58.267217 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.267217 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:58.268873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.269432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:58.313706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:58.314225 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:17:58.315407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:58.315744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.316830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:58.316830 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.316830 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:58.316830 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.316830 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.316830 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:58.316830 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.316830 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:58.318555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:58.319545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:58.319545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.319545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:58.319545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.319545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.319545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:58.319545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.319545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:17:58.319944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.320955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.322050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:58.322050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.322050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:58.327833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:58.328538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:58.329589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:58.330342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.331573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:58.331573 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.331573 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:58.331573 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.331573 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.331573 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:58.331573 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.331573 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:17:58.333096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:58.333694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:17:58.333694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.333694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:17:58.333694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.333694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.333694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:17:58.333694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.333694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:17:58.334786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.335646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:58.336323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.336323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:17:58.503249 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:17:58.503763 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:17:58.504791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:58.505281 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:17:58.505528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.506512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:17:58.506512 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.506512 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:17:58.506512 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.506512 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.506512 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:17:58.506512 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.506512 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.508523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:17:58.509409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:03.068859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:03.070981 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:03.105533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:03.106062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.106872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:03.106872 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.106872 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:03.106872 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.106872 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.106872 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:03.106872 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.106872 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.108475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.109039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:03.263494 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:03.265347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:03.265922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:03.266321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.267799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:18:03.267799 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.267799 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:03.267799 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.267799 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.267799 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:03.267799 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.267799 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:03.270715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.271780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:03.314499 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:03.315070 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:03.315747 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:03.316124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.316979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:03.316979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.316979 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:03.316979 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.316979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.316979 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:03.316979 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.316979 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:03.317976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:03.318490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:03.318490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.318490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:03.318490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.318490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.318490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:03.318490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.318490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:03.319077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.319708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.320227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:03.320227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.320227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:03.328446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:03.328975 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:03.329778 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:03.330337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.331153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:03.331153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.331153 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:03.331153 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.331153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.331153 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:03.331153 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.331153 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:03.333832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:03.334848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:03.334848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.334848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:03.334848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.334848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.334848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:03.334848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.334848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:03.335275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.336197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:03.337198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.337198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:03.504061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:03.504693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:03.505570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:03.506073 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:03.506460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.507275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:03.507275 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.507275 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:03.507275 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.507275 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.507275 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:03.507275 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.507275 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.509142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:03.510011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:08.069589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:08.071293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:08.112590 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:08.112986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.114004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:08.114004 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.114004 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:08.114004 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.114004 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.114004 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:08.114004 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.114004 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.115078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.116027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:08.264551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:08.266398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:08.266795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:08.267126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.268261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:08.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:08.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.268261 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:08.268261 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.268261 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.270910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.272004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:08.315241 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:08.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:08.316600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:08.317097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.318515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:08.318515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.318515 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:08.318515 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.318515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.318515 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:08.318515 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.318515 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:08.319539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:08.320450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:08.320450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.320450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:08.320450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.320450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.320450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:08.320450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.320450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:08.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.321413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.321988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:08.321988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.321988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:08.328864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:08.329124 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:08.329850 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:08.330275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.331248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:08.331248 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.331248 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:08.331248 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.331248 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.331248 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:08.331248 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.331248 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:08.332133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:08.332617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:08.332617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.332617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:08.332617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.332617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.332617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:08.332617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.332617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:08.333192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.333661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:08.334164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.334164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:08.505031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:08.505659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:08.506656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:08.507125 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:08.507397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:08.508375 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.508375 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:08.508375 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.508375 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.508375 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:08.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.508375 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.510508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:08.511735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:13.070218 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:13.072156 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:13.113246 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:13.113727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.114471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:13.114471 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.114471 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:13.114471 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.114471 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.114471 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:13.114471 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.114471 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.115513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.116444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:13.265427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:13.267176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:13.267668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:13.267806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.268987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:18:13.268987 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.268987 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:13.268987 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.268987 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.268987 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:13.268987 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.268987 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:13.271776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.272640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:13.316061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:13.316652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:13.317686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:13.318139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.319138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:13.319138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.319138 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:13.319138 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.319138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.319138 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:13.319138 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.319138 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:13.320718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:13.321585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:13.321585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.321585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:13.321585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.321585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.321585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:13.321585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.321585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:13.322190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.322924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.323765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:13.323765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.323765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:13.329365 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:13.329856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:13.330849 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:13.331340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.332253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:13.332253 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.332253 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:13.332253 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.332253 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.332253 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:13.332253 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.332253 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:13.333327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:13.334422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:13.334422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.334422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:13.334422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.334422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.334422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:13.334422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.334422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:13.334952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.335809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:13.336849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.336849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:13.505856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:13.506771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:13.507556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:13.507899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:13.508099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.508955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:13.508955 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.508955 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:13.508955 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.508955 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.508955 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:13.508955 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.508955 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.510976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:13.511838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:18.071215 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:18.073123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:18.116114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:18.116642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.117792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:18.117792 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.117792 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:18.117792 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.117792 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.117792 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:18.117792 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.117792 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.119153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.119947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:18.266380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:18.268136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:18.268505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:18.268752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.269752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:18.269752 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.269752 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:18.269752 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.269752 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.269752 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:18.269752 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.269752 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.271165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.272043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:18.316783 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:18.317226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:18.318159 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:18.318499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.319494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:18.319494 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.319494 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:18.319494 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.319494 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.319494 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:18.319494 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.319494 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:18.320994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:18.321852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:18.321852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.321852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:18.321852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.321852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.321852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:18.321852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.321852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:18.323085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.323866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.324741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:18.324741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.324741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:18.330016 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:18.330701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:18.331379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:18.331781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.332636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:18.332636 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.332636 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:18.332636 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.332636 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.332636 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:18.332636 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.332636 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:18.334208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:18.334828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:18.334828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.334828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:18.334828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.334828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.334828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:18.334828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.334828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:18.335845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.336623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:18.337448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.337448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:18.506604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:18.507536 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:18.508441 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:18.508814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:18.509069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.510051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:18.510051 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.510051 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:18.510051 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.510051 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.510051 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:18.510051 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.510051 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.512102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:18.512912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:23.071935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:23.073521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:23.122001 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:23.122427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.123656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:23.123656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.123656 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:23.123656 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.123656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.123656 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:23.123656 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.123656 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.125310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.126429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:23.267254 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:23.269157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:23.269582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:23.269840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.271060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:23.271060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.271060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:23.271060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.271060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.271060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:23.271060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.271060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.273159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:23.317697 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:23.318628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:23.319850 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:23.320259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.321351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:23.321351 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.321351 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:23.321351 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.321351 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.321351 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:23.321351 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.321351 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:23.322631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:23.323631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:23.323631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.323631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:23.323631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.323631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.323631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:23.323631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.323631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:23.324413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.324914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.325431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:23.325431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.325431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:23.330482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:23.331034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:23.331528 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:23.331834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.332351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:23.332351 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.332351 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:23.332351 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.332351 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.332351 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:23.332351 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.332351 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:23.333357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:23.334173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:23.334173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.334173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:23.334173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.334173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.334173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:23.334173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.334173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:23.334530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.335350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:23.336194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.336194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:23.507581 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:23.508447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:23.509053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:23.509576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:23.509681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.510642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:23.510642 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.510642 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:23.510642 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.510642 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.510642 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:23.510642 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.510642 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.512017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:23.512866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:28.072749 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:28.075347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:28.112155 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:28.112584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:28.115109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:28.115686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.116269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:28.116269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.116269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.116269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:28.116269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.116269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:28.267899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:28.269577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:28.270057 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:28.270360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.271462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:28.271462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.271462 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:28.271462 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.271462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.271462 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:28.271462 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.271462 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.273681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.274790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:28.318421 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:28.319148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:28.319839 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:28.320306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.321614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:28.321614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.321614 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:28.321614 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.321614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.321614 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:28.321614 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.321614 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:28.323457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:28.323994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:28.323994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.323994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:28.323994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.323994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.323994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:28.323994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.323994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:28.325250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.325696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.326202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:28.326202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.326202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:28.330862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:28.331543 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:28.332835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:28.333402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.334404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:28.334404 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.334404 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:28.334404 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.334404 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.334404 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:28.334404 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.334404 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:28.335409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:28.335926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:28.335926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.335926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:28.335926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.335926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.335926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:28.335926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.335926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:28.336817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.337471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:28.337987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.337987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:28.508388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:28.509303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:28.510398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:28.510831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:28.511172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.512192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:28.512192 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.512192 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:28.512192 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.512192 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.512192 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:28.512192 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.512192 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.514209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:28.515328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:33.074094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:33.076310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:33.109746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:33.110049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.110689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:33.110689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.110689 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:33.110689 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.110689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.110689 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:33.110689 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.110689 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.111995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.112858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:33.268836 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:33.270641 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:33.271076 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:33.271437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.272655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:33.272655 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.272655 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:33.272655 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.272655 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.272655 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:33.272655 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.272655 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.274751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.275663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:33.319180 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:33.319872 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:33.320630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:33.321146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.322345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:33.322345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.322345 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:33.322345 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.322345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.322345 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:33.322345 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.322345 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:33.323346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.324526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:33.325640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.326869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:33.331578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:33.332274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:33.332835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:33.333178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.333760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:33.333760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.333760 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:33.333760 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.333760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.333760 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:33.333760 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.333760 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:33.335370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:33.336160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:33.336160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.336160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:33.336160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.336160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.336160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:33.336160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.336160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:33.336850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.337676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:33.338710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.338710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:33.520507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:33.521400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:33.522221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:33.522530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:33.522703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.523559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:33.523559 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.523559 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:33.523559 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.523559 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.523559 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:33.523559 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.523559 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.525531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:33.526673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:38.074918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:38.076827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:38.078965 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=244 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:18:38.118128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:38.118318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.118855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:38.118855 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.118855 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:38.118855 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.118855 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.118855 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:38.118855 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.118855 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.119680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.120488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:38.270782 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:38.272970 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:38.273429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:38.273692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.274691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:38.274691 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.274691 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:38.274691 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.274691 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.274691 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:38.274691 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.274691 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.276955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.277757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:38.319785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:38.320511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:38.321459 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:38.321821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.322798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:38.322798 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.322798 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:38.322798 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.322798 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.322798 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:38.322798 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.322798 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:38.324208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:38.325078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:38.325078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.325078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:38.325078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.325078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.325078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:38.325078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.325078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:38.325790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.326552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.327424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:38.327424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.327424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:38.332178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:38.332808 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:38.333506 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:38.334032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.334900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:38.334900 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.334900 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:38.334900 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.334900 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.334900 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:38.334900 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.334900 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:38.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:38.336960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:38.336960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.336960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:38.336960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.336960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.336960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:38.336960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.336960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:38.338124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:38.339051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.339051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:38.521537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:38.522270 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:38.523030 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:38.523379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:38.523555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.524329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:38.524329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.524329 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:38.524329 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.524329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.524329 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:38.524329 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.524329 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.525593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:38.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:43.075804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:43.076739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:43.136170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.137920 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.139289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.140034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:43.272576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:43.273831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:43.274131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:43.274413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.275248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:18:43.275248 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.275248 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:43.275248 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.275248 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.275248 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:43.275248 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.275248 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:43.276766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.277760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:43.320485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:43.321753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:43.324588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:43.324805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:43.326973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.327715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.328086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.328463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:43.333071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:43.333071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:43.333549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:43.333910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.334406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:43.334406 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.334406 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:43.334406 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.334406 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.334406 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:43.334406 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.334406 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:43.335207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:43.335580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:43.335580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.335580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:43.335580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.335580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.335580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:43.335580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.335580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:43.336292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.336670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:43.337098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.337098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:43.522223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:43.524674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:43.526350 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:43.526603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:43.526732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.527338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:43.527338 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.527338 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:43.527338 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.527338 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.527338 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:43.527338 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.527338 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.528319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:43.529082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:48.076602 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:48.078710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:48.273389 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:48.275216 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:48.275665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:48.276065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.277343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:18:48.277343 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.277343 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:48.277343 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.277343 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.277343 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:48.277343 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.277343 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:48.280407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.281412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:48.321737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:48.322447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:48.323422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:48.323865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.324836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:18:48.324836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.324836 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:48.324836 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.324836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.324836 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:48.324836 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.324836 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:48.326478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.326974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:48.328297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.329833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.331171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:48.331171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.331171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:48.333518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:48.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:48.334724 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:48.335457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.336863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:48.336863 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.336863 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:48.336863 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.336863 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.336863 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:48.336863 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.336863 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:48.341405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:48.342517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:48.342517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.342517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:48.342517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.342517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.342517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:48.342517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.342517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:48.344195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.344629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:48.345142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.345142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:48.369193 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:48.369753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.370923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:18:48.370923 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.370923 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:48.370923 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.370923 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.370923 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:48.370923 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.370923 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.372389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.373268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:48.524669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:48.525129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:48.526417 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:48.526417 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:48.526701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.527658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:48.527658 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.527658 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:48.527658 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.527658 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.527658 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:48.527658 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.527658 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:48.530358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:53.077393 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:53.078872 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:53.152551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:53.152839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.153586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:18:53.153586 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.153586 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:53.153586 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.153586 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.153586 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:53.153586 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.153586 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.154446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.155471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:53.274302 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:53.275732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:53.276122 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:53.276677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.277940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:18:53.277940 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.277940 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:53.277940 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.277940 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.277940 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:53.277940 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.277940 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:53.279921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.280669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:53.322551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:53.323557 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:53.324489 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:53.324916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.326023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:18:53.326023 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.326023 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:53.326023 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.326023 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.326023 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:53.326023 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.326023 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:53.327431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.328170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:53.329136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.330086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.330645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:53.330645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.330645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:53.333874 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:53.334388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:53.335013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:53.335395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.336190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:53.336190 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.336190 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:53.336190 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.336190 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.336190 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:53.336190 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.336190 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:53.337377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:53.337793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:53.337793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.337793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:53.337793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.337793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.337793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:53.337793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.337793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:53.338701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.339463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:53.341345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.341345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:53.525388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:53.526110 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:53.526903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:53.527369 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:53.527671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.528912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:53.528912 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.528912 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:53.528912 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.528912 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.528912 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:53.528912 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.528912 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.530729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:53.531482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:58.078225 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:58.080353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:58.113376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:58.113857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.114790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:18:58.114790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.114790 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:58.114790 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.114790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.114790 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:58.114790 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.114790 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.115796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.116748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:58.275730 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:58.277920 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:58.278349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:58.278634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.279871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:18:58.279871 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.279871 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:58.279871 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.279871 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.279871 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:58.279871 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.279871 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:58.282021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.283047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:58.323534 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:58.324337 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:18:58.325264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:58.325576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:18:58.326405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.326405 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:58.326405 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.326405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.326405 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:58.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.326405 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:58.327471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.327851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:18:58.328792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.329202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.329745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:58.329745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.329745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:58.334413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:58.335132 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:58.335963 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:58.336377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.337863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:18:58.337863 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.337863 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:58.337863 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.337863 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.337863 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:58.337863 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.337863 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:18:58.338380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.338947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:18:58.339416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.339984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:58.341098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.341098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:18:58.526451 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:18:58.527402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:18:58.528360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:58.528783 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:18:58.529513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.529621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:18:58.529621 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.529621 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:18:58.529621 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.529621 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.529621 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:18:58.529621 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.529621 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.531631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:18:58.532630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:03.078993 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:03.081112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:03.129963 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:03.130301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.131422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:03.131422 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.131422 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:03.131422 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.131422 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.131422 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:03.131422 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.131422 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.133850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.134547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:03.277924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:03.279657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:03.279897 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:03.280050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.281092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:19:03.281092 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.281092 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:03.281092 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.281092 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.281092 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:03.281092 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.281092 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:03.283468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.283896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:03.324290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:03.325409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:03.326311 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:03.326713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.329716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.330390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:03.331137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.331583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.332098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:03.332098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.332098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:03.335022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:03.335382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:03.335891 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:03.336154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.336745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:03.336745 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.336745 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:03.336745 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.336745 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.336745 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:03.336745 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.336745 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:03.338314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:03.338773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:03.338773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.338773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:03.338773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.338773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.338773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:03.338773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.338773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:03.339506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.340021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:03.340573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.340573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:03.527474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:03.527905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:03.528777 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:03.529161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:03.529334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.530127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:03.530127 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.530127 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:03.530127 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.530127 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.530127 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:03.530127 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.530127 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.532024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:03.532517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:08.080599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:08.082387 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:08.122062 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:08.122493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.123482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:08.123482 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.123482 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:08.123482 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.123482 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.123482 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:08.123482 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.123482 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.124497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:08.280289 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:08.280601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:08.281109 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:08.281415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.282689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:19:08.282689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.282689 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:08.282689 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.282689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.282689 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:08.282689 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.282689 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:08.284770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.285237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:08.325287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:08.325941 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:08.326571 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:08.327001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.327838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:08.327838 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.327838 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:08.327838 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.327838 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.327838 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:08.327838 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.327838 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:08.329232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.329691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:08.331093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.331556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.332232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:08.332232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.332232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:08.335519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:08.335909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:08.336535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:08.336900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.337721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:08.337721 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.337721 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:08.337721 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.337721 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.337721 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:08.337721 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.337721 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:08.339188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:08.339903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:08.339903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.339903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:08.339903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.339903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.339903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:08.339903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.339903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:08.340790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.341544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:08.342374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.342374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:08.528205 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:08.529009 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:08.530023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:08.530495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:08.530761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.531835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:08.531835 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.531835 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:08.531835 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.531835 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.531835 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:08.531835 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.531835 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.533838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:08.534819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:13.081510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:13.082852 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:13.125768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:13.126146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.127204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:13.127204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.127204 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:13.127204 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.127204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.127204 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:13.127204 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.127204 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.128697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.129306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:13.279827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:13.281721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:13.282147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:13.282404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.283611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:13.283611 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.283611 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:13.283611 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.283611 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.283611 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:13.283611 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.283611 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:13.286258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.287203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:13.326264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:13.327107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:13.327992 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:13.328290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.329152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:13.329152 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.329152 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:13.329152 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.329152 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.329152 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:13.329152 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.329152 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:13.330404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.331116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:13.331883 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.332819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.333961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:13.333961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.333961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:13.336137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:13.336512 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:13.337047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:13.337323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.337982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:13.337982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.337982 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:13.337982 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.337982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.337982 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:13.337982 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.337982 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:13.339254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:13.339723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:13.339723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.339723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:13.339723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.339723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.339723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:13.339723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.339723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:13.340669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.341206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:13.341723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.341723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:13.529264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:13.530055 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:13.530544 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:13.530814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:13.530974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.531548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:13.531548 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.531548 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:13.531548 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.531548 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.531548 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:13.531548 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.531548 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.533296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:13.533858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:18.082359 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:18.084295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:18.124744 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:18.125112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:18.126029 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.126029 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:18.126029 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.126029 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.126029 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:18.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.127444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.128058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.300190 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:18.301870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.303480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:18.327076 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:18.327863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:18.328800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:18.329266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.330125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:18.330125 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.330125 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:18.330125 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.330125 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.330125 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:18.330125 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.330125 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:18.331563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.332521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:18.333834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.334676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.335825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:18.335825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.335825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:18.336771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:18.337065 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:18.337576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:18.337980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.338717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:18.338717 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.338717 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:18.338717 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.338717 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.338717 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:18.338717 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.338717 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:18.339842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:18.340560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:18.340560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.340560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:18.340560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.340560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.340560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:18.340560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.340560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:18.341161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.341678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:18.342366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.342366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:18.533943 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:18.534469 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:18.535280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:18.535657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:18.535866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.536647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:18.536647 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.536647 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:18.536647 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.536647 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.536647 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:18.536647 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.536647 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.538349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:18.539493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:23.083390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:23.085769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:23.134475 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:23.135500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.135677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:23.135677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.135677 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:23.135677 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.135677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.135677 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:23.135677 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.135677 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.136724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.138060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:23.281722 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:23.283974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:23.284153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:23.284386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.285374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:23.285374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.285374 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:23.285374 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.285374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.285374 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:23.285374 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.285374 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:23.287314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.288182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:23.327919 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:23.328691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:23.329582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:23.330049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.331075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:23.331075 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.331075 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:23.331075 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.331075 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.331075 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:23.331075 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.331075 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:23.332207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.332911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:23.334213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.334768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.335307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:23.335307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.335307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:23.337209 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:23.337603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:23.338155 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.339134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:23.339134 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.339134 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:23.339134 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.339134 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.339134 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:23.339134 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.339134 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:23.340517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:23.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:23.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:23.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:23.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:23.341785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.342285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:23.342773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.342773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:23.534702 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:23.535248 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:23.537431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:23.537431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:23.537431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.538323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:23.538323 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.538323 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:23.538323 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.538323 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.538323 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:23.538323 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.538323 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.540826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:23.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:28.084253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:28.086029 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:28.118689 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:28.118915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:28.138234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:28.139752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.141134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:28.141134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.141134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.141134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:28.141134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.141134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:28.282433 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:28.284156 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:28.284677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:28.284990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.286176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:28.286176 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.286176 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:28.286176 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.286176 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.286176 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:28.286176 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.286176 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:28.288085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:28.328604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:28.329407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:28.330526 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:28.331005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.331995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:28.331995 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.331995 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:28.331995 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.331995 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.331995 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:28.331995 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.331995 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:28.333086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.333794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:28.334171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.334964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.335790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:28.335790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.335790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:28.337657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:28.338223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:28.338661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:28.338960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.339500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:28.339500 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.339500 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:28.339500 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.339500 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.339500 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:28.339500 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.339500 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:28.340567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:28.341140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:28.341140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.341140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:28.341140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.341140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.341140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:28.341140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.341140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:28.341632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.342167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:28.342807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.342807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:28.535644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:28.536360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:28.537513 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:28.537747 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:28.537994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.539075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:28.539075 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.539075 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:28.539075 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.539075 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.539075 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:28.539075 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.539075 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.541201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:28.542308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:33.084982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:33.087132 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:33.132342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:33.132800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.133873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:33.133873 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.133873 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:33.133873 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.133873 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.133873 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:33.133873 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.133873 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.135010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.136376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:33.284068 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:33.291009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.292749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.293690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:33.329263 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:33.330154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:33.331082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:33.331429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.332577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:33.332577 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.332577 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:33.332577 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.332577 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.332577 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:33.332577 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.332577 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:33.334341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.335200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:33.336477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.337412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.338268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:33.338268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.338268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:33.338268 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:33.338721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:33.339286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:33.339755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.344091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:33.344091 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.344091 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:33.344091 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.344091 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.344091 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:33.344091 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.344091 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:33.344909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:33.345523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:33.345523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.345523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:33.345523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.345523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.345523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:33.345523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.345523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:33.345937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.346573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:33.347225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.347225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:33.536551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:33.537412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:33.540770 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:33.541145 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:33.541331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.542071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:33.542071 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.542071 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:33.542071 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.542071 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.542071 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:33.542071 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.542071 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.543371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:33.543757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:37.986340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:37.996206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:389}}
Mar 19 18:19:37.996385 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, security_groups=2, routers=1, router_ports=1 {{(pid=103900) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:370}}
Mar 19 18:19:37.996501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Fixing resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:19:38.035079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, resource={'id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'name': 'private', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb', 'bee598c2-f62b-4321-b08d-23e3a7c6ccb9'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:09:27Z', 'updated_at': '2026-03-19T18:09:31Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 29513}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.035449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.035945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b55270e8-5359-4f54-8804-fcbd7769eee3, external_ids_update=None, columns={'tag': 29513}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.036094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.037023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:38.037023 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.037023 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.037023 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.037023 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.037023 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.037023 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.037023 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Failed to fix resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.038661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.039193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.039771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:19:38.039771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.039771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:19:38.039771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Fixing resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:19:38.079837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, resource={'id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'name': 'public', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['7888df47-ce34-4091-9e08-c1c5949f53a2', 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-03-19T18:09:34Z', 'updated_at': '2026-03-19T18:09:44Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.079837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-20b6196a-9254-4b37-a645-8253845242a7, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.080409 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Failed to fix resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.080895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.081602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.082213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:19:38.082213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.082213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:19:38.082213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Fixing resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:19:38.085535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:38.091331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:38.092899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=287 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:19:38.151206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-420e2995-aa57-46db-9651-85807f50bcb9, resource={'id': '420e2995-aa57-46db-9651-85807f50bcb9', 'name': 'admin_net', 'tenant_id': '1ed140779dbc462d89fd3e785886b2bb', 'project_id': '1ed140779dbc462d89fd3e785886b2bb', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['388b450f-f17e-4671-94e9-9f169d754be7'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:13:33Z', 'updated_at': '2026-03-19T18:13:34Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 28229}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.151487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-420e2995-aa57-46db-9651-85807f50bcb9, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.151854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-07b4049d-60f0-4621-a8e7-5dcac93308be, external_ids_update=None, columns={'tag': 28229}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.152022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.154148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:38.154148 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.154148 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.154148 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.154148 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.154148 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.154148 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.154148 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Failed to fix resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.157065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.157597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.158234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:19:38.158234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.158234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:19:38.158234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Fixing resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:19:38.174950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.175284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.177956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:38.177956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.177956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.177956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.177956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.177956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.177956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.177956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.182955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.183808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:38.202836 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, resource={'id': '4d64a793-ee68-4a18-b938-f55304c6fcf6', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0bc68cc0-48dc-4abe-bbac-0a4f654efb2e'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:14:20Z', 'updated_at': '2026-03-19T18:14:21Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 59295}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.203372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.203940 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-42ff4b0a-bf0a-4937-bf0f-c8b42f68f267, external_ids_update=None, columns={'tag': 59295}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.204236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.205524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:38.205524 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.205524 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.205524 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.205524 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.205524 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.205524 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.205524 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Failed to fix resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.206740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.207455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.208099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:19:38.208099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.208099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:19:38.208099 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Fixing resource 69e38a66-4297-4438-8519-146b184a7ed7 (type: security_groups) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:19:38.257649 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.db.ovn_revision_numbers_db [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Successfully bumped revision number for resource 69e38a66-4297-4438-8519-146b184a7ed7 (type: security_groups) to 10
Mar 19 18:19:38.258147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Fixing resource 5eb30ef4-651b-4792-9bbf-2bc7bf51f4a2 (type: security_groups) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:19:38.286742 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:38.291093 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.291641 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:38.317299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.319800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:38.323754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.323754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:38.323754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.323754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.323754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:38.323754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.323754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:38.330040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:38.330653 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:38.331538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.331887 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.332755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:38.332755 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.332755 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.332755 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.332755 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.332755 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.332755 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.332755 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:38.334524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.334977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:38.336683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.337213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.337758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:38.337758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.337758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:38.338530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:38.339508 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:38.340048 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.340405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.341189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:38.341189 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.341189 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.341189 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.341189 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.341189 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.341189 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.341189 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:38.342551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.343041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:38.343041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.343041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:38.343041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.343041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.343041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:38.343041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.343041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:38.344398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.344944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:38.345436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.345436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:38.378450 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.db.ovn_revision_numbers_db [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Successfully bumped revision number for resource 5eb30ef4-651b-4792-9bbf-2bc7bf51f4a2 (type: security_groups) to 15
Mar 19 18:19:38.378721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Fixing resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:19:38.538252 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:38.539136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:38.540344 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.541616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.541845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.543116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:38.543116 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.543116 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.543116 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.543116 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.543116 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.543116 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.543116 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.553541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:38.564059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, resource={'id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'enable_snat': True}, 'gw_port_id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-1id6n', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'ip_address': '172.24.5.52', 'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, {'ip_address': '2001:db8::2c3', 'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:25Z', 'revision_number': 3, 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89'}, resource_type=routers, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.564695 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.565217 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.565487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.565703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.566920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:38.566920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.566920 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.566920 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.566920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.566920 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.566920 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.566920 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.567328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Unable to update router cf5e0251-94c8-4bce-b873-648b8cc72809. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Failed to fix resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Mar 19 18:19:38.569346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:19:38.569699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:19:38.570075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Fixing resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:19:38.732597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, resource={'id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'name': '', 'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'project_id': '', 'mac_address': 'fa:16:3e:11:31:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000160124', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:24Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.732970 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::2c3/64', '172.24.5.52/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.733451 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=f319bf7e-5d34-47af-b620-bec8597c3819, lrouter_port=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:38.733771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.734836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Traceback (most recent call last):
Mar 19 18:19:38.734836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.734836 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:38.734836 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.734836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.734836 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:38.734836 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.734836 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Failed to fix resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.736392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:19:38.736862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:38.737281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:19:38.737281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:38.737281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:19:38.737281 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c05c8867-1898-4f1d-a603-342c4884638d None None] Maintenance task: Synchronization completed (took 0.74 seconds)
Mar 19 18:19:43.086440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:43.087783 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:43.123223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:43.123554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.124421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:43.124421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.124421 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:43.124421 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.124421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.124421 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:43.124421 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.124421 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.125998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.127106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:43.289852 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:43.291618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:43.292224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:43.292350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.293715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:19:43.293715 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.293715 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:43.293715 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.293715 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.293715 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:43.293715 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.293715 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:43.294798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.295721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:43.330813 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.384549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.384962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:43.385758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:43.386388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:43.386863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:43.387164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:43.387164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.387727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:19:43.387727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.387727 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:43.387727 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.387727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.387727 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:43.387727 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.387727 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:43.388550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.388866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:43.389372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.389734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:43.390163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.390163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:43.539449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:43.540114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:43.541326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:43.542137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:43.542137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.542339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:43.542339 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.542339 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:43.542339 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.542339 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.542339 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:43.542339 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.542339 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.543230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:43.543653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:48.087919 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:48.090177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:48.130247 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:48.130656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.131737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:48.131737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.131737 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:48.131737 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.131737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.131737 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:48.131737 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.131737 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.133214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.133919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:48.290974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:48.292330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:48.292600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:48.292788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.293938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:19:48.293938 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.293938 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:48.293938 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.293938 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.293938 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:48.293938 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.293938 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:48.295978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.296668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:48.331589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:48.332315 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:48.332844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:48.333136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.333991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:48.333991 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.333991 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:48.333991 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.333991 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.333991 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:48.333991 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.333991 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:48.335805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.336610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:48.337818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.338668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.339497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:48.339497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.339497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:48.386263 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:48.387607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:48.388733 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:48.389418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.390436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:48.390436 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.390436 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:48.390436 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.390436 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.390436 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:48.390436 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.390436 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:48.392176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:48.392832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:48.392832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.392832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:48.392832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.392832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.392832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:48.392832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.392832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:48.394035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.394784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:48.395602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.395602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:48.540380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:48.541069 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:48.541862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:48.542354 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:48.542615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.543620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:48.543620 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.543620 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:48.543620 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.543620 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.543620 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:48.543620 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.543620 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.545734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:48.546559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:53.088610 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:53.092353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:53.144518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:53.145129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.146250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:53.146250 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.146250 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:53.146250 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.146250 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.146250 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:53.146250 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.146250 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.147688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.148156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:53.293381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:53.295646 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:53.300020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:53.300020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.303855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:19:53.303855 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.303855 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:53.303855 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.303855 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.303855 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:53.303855 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.303855 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:53.305425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.305813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:53.332394 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:53.332745 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:53.333318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:53.333734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.335914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.336529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:53.337785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.338498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.339218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:53.339218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.339218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:53.388934 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:53.393457 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:53.394979 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:53.395402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.396477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:19:53.396477 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.396477 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:53.396477 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.396477 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.396477 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:53.396477 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.396477 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:53.398434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.398823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:53.399266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.399665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:53.400171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.400171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:53.541119 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:53.541754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:53.543511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:53.543511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:53.543511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.543667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:53.543667 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.543667 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:53.543667 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.543667 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.543667 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:53.543667 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.543667 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.544613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:53.545135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:58.089653 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:58.090747 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.143085 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.144530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.145263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:58.295193 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:58.297020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:58.297452 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:58.297711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.298833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:58.298833 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.298833 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:58.298833 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.298833 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.298833 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:58.298833 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.298833 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.300839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.301741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:58.333074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:58.333722 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:19:58.334395 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:58.334643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.335655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:19:58.335655 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.335655 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:58.335655 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.335655 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.335655 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:58.335655 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.335655 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:58.337128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:58.444025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.444748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:58.445638 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.446365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.447099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.447725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:58.448580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.449421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.449421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:58.449421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.449421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:19:58.542021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:19:58.542687 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:19:58.543569 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:58.544023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:19:58.544279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.545416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:19:58.545416 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.545416 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:19:58.545416 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.545416 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.545416 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:19:58.545416 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.545416 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.547111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:19:58.547984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:03.090434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:03.092540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:03.137748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:03.138100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.138832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:03.138832 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.138832 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:03.138832 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.138832 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.138832 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:03.138832 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.138832 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.140104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.140590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:03.295829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:03.297049 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:03.297295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:03.297458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.298139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:03.298139 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.298139 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:03.298139 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.298139 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.298139 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:03.298139 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.298139 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:03.299224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.300009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:03.333775 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:03.334593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:03.335156 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:03.335466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.336207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:03.336207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.336207 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:03.336207 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.336207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.336207 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:03.336207 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.336207 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:03.337072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.337616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:03.338337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.339057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.339653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:03.339653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.339653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:03.392177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:03.392719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:03.393810 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:03.394337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.395412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:03.395412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.395412 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:03.395412 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.395412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.395412 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:03.395412 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.395412 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:03.396161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.396965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:03.397623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.398847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:03.542851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:03.555594 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:03.557266 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:03.557548 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:03.557548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.558951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:03.558951 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.558951 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:03.558951 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.558951 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.558951 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:03.558951 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.558951 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.560298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:03.560820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:08.091231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:08.093668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:08.152932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:08.153283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.154412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:08.154412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.154412 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:08.154412 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.154412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.154412 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:08.154412 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.154412 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.157150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.157800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:08.296559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:08.297850 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:08.298190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:08.298342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.299445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:08.299445 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.299445 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:08.299445 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.299445 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.299445 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:08.299445 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.299445 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:08.301004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.301928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:08.334639 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:08.335240 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:08.336033 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:08.336265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.337336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:08.337336 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.337336 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:08.337336 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.337336 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.337336 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:08.337336 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.337336 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:08.338636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.339164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:08.340413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.340964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:08.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.341510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:08.393434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:08.396476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:08.397212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:08.397654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.400761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:08.400761 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.400761 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:08.400761 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.400761 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.400761 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:08.400761 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.400761 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:08.401532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:08.402078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:08.402078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.402078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:08.402078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.402078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.402078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:08.402078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.402078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:08.402332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.402860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:08.403447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.403447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:08.556105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:08.556612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:08.557474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:08.557827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:08.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.559296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:08.559296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.559296 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:08.559296 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.559296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.559296 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:08.559296 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.559296 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.561301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:08.561903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:13.092012 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:13.093305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:13.129330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:13.129786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.130830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:13.130830 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.130830 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:13.130830 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.130830 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.130830 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:13.130830 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.130830 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.131818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.147326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:13.297362 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:13.299633 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:13.299912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:13.300146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.301652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:13.301652 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.301652 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:13.301652 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.301652 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.301652 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:13.301652 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.301652 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:13.302892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.303293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:13.335231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:13.335992 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:13.336791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:13.337404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.338258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:13.338258 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.338258 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:13.338258 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.338258 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.338258 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:13.338258 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.338258 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:13.339079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.339540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:13.340342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.340851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.341478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:13.341478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.341478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:13.396827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:13.397283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:13.398280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:13.398598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.400141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:13.400141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.400141 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:13.400141 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.400141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.400141 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:13.400141 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.400141 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:13.401767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:13.402331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:13.402331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.402331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:13.402331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.402331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.402331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:13.402331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.402331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:13.403790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.404521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:13.405277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.405277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:13.558555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:13.558555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:13.558555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:13.558555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:13.558849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.559422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:13.559422 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.559422 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:13.559422 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.559422 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.559422 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:13.559422 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.559422 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.560826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:13.561369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:18.092909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:18.095576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:18.148064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:18.148369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:18.160733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:18.162180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.164623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:18.164623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.164623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.164623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:18.164623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.164623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:18.298375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:18.299744 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:18.300067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:18.300254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.301061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:18.301061 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.301061 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:18.301061 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.301061 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.301061 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:18.301061 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.301061 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:18.302420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.302850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.362322 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:18.363488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.364621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:18.365414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.366312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:18.397373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:18.397972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:18.398955 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:18.399258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.400392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:18.400392 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.400392 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:18.400392 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.400392 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.400392 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:18.400392 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.400392 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:18.401229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:18.401800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:18.401800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.401800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:18.401800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.401800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.401800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:18.401800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.401800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:18.402070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.402618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:18.403223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.403223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:18.557673 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:18.558280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:18.559312 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:18.559909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:18.560405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.561409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:18.561409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.561409 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:18.561409 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.561409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.561409 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:18.561409 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.561409 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.563564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:18.564455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:23.094053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:23.095305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:23.148684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:23.149203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.150594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:23.150594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.150594 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:23.150594 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.150594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.150594 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:23.150594 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.150594 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.151889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.153040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:23.299204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:23.300665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:23.300899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:23.301073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.301921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:23.301921 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.301921 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:23.301921 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.301921 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.301921 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:23.301921 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.301921 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:23.303059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.304192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:23.336849 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:23.338604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:23.339345 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:23.339717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:23.340734 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.340734 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:23.340734 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.340734 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.340734 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:23.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:23.342617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.343292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:23.344727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.345118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.345483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:23.345483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.345483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:23.398129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:23.398312 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:23.399183 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:23.399512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.400285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:23.400285 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.400285 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:23.400285 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.400285 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.400285 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:23.400285 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.400285 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:23.401121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:23.401609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:23.401609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.401609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:23.401609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.401609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.401609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:23.401609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.401609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:23.402120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.402502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:23.402859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.402859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:23.558373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:23.558687 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:23.559727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:23.560210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:23.560481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.561441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:23.561441 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.561441 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:23.561441 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.561441 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.561441 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:23.561441 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.561441 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.562824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:23.564751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.402551 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.404490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.405782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.407074 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:28.407630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.408297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.409153 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:28.409793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:28.410338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.410786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:28.411262 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.411656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.412211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.412615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:28.413174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.413708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.413708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:28.413708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.413708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:28.559234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:28.559979 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:28.560450 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:28.560835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:28.561056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.561614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:28.561614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.561614 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:28.561614 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.561614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.561614 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:28.561614 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.561614 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.562654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:28.563706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:33.103559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:33.104530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:33.175506 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:33.175593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.176400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:33.176400 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.176400 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:33.176400 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.176400 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.176400 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:33.176400 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.176400 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.178510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.180320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:33.300911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:33.302647 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:33.303091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:33.303327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.304323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:33.304323 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.304323 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:33.304323 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.304323 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.304323 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:33.304323 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.304323 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:33.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.306853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:33.339201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:33.340187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:33.341085 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:33.341713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.342720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:33.342720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.342720 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:33.342720 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.342720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.342720 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:33.342720 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.342720 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:33.343817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.344606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:33.345069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.345729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.346494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:33.346494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.346494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:33.399486 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:33.400095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:33.401065 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:33.401706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.402401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:33.402401 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.402401 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:33.402401 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.402401 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.402401 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:33.402401 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.402401 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:33.403394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:33.404177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:33.404177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.404177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:33.404177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.404177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.404177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:33.404177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.404177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:33.404526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.405420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:33.406456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.406456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.567974 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:33.568825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:33.569742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:38.104492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:38.106239 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:38.145130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=427,neutron:UPDATE=2 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:20:38.175732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:38.176089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.177417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:38.177417 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.177417 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:38.177417 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.177417 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.177417 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:38.177417 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.177417 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.182067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.182988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:38.301733 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:38.303346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:38.303569 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:38.303695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.304652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:38.304652 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.304652 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:38.304652 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.304652 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.304652 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:38.304652 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.304652 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:38.307299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.308222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:38.340043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:38.340708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:38.341535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:38.341781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.342484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:38.342484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.342484 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:38.342484 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.342484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.342484 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:38.342484 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.342484 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:38.343372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:38.344370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.345129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.346094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:38.400274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:38.400844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:38.401814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:38.402302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.404234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:38.404234 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.404234 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:38.404234 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.404234 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.404234 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:38.404234 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.404234 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:38.405241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:38.406475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.407237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:38.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:38.560859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:38.561680 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:38.562571 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:38.563081 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:38.563364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.564529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:38.564529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.564529 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:38.564529 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.564529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.564529 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:38.564529 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.564529 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.566518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:38.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:43.105159 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:43.106543 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:43.144379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:43.144796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.145715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:43.145715 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.145715 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:43.145715 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.145715 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.145715 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:43.145715 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.145715 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.146790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.147670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:43.302658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:43.322178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.322847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.323828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:43.341006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:43.341500 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:43.342246 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:43.342612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.343709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:43.343709 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.343709 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:43.343709 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.343709 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.343709 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:43.343709 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.343709 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:43.345386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.346131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:43.347154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.348010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.349036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:43.349036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.349036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:43.401119 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:43.401927 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:43.402784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:43.403381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.404615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:43.404615 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.404615 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:43.404615 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.404615 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.404615 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:43.404615 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.404615 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:43.406207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:43.406998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:43.406998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.406998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:43.406998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.406998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.406998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:43.406998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.406998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:43.408356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.409232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:43.410101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.410101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:43.561687 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:43.563010 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:43.564151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:43.564445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:43.564700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.565867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:43.565867 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.565867 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:43.565867 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.565867 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.565867 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:43.565867 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.565867 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.567802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:43.568652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:48.105823 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:48.107868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:48.151555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:48.151841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.152510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:48.152510 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.152510 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:48.152510 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.152510 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.152510 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:48.152510 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.152510 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.153609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.154600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:48.303552 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:48.305276 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:48.305734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:48.306159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.307315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:48.307315 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.307315 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:48.307315 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.307315 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.307315 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:48.307315 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.307315 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:48.309420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.310399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:48.341769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:48.342249 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:48.343089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:48.343439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.344482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:48.344482 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.344482 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:48.344482 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.344482 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.344482 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:48.344482 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.344482 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:48.345538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.346298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:48.346726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.347440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.348276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:48.348276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.348276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:48.402059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:48.402645 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:48.403687 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:48.404248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.405126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:48.405126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.405126 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:48.405126 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.405126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.405126 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:48.405126 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.405126 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:48.406241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:48.407094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:48.407094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.407094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:48.407094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.407094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.407094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:48.407094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.407094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:48.407624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.408423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:48.409482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.409482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:48.563169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:48.563820 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:48.564678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:48.564969 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:48.565102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.565729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:48.565729 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.565729 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:48.565729 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.565729 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.565729 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:48.565729 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.565729 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.566994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:48.567858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:53.106637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:53.108624 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:53.155580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:53.156255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.157331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:53.157331 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.157331 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:53.157331 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.157331 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.157331 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:53.157331 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.157331 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.158719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:53.304485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:53.306121 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:53.306555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:53.306845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.308016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:53.308016 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.308016 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:53.308016 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.308016 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.308016 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:53.308016 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.308016 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:53.310044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.310787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:53.342580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:53.343603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:53.344412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:53.344780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.345769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:53.345769 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.345769 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:53.345769 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.345769 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.345769 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:53.345769 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.345769 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:53.347625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.348580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:53.350121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.350637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.351319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:53.351319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.351319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:53.402994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:53.403604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:53.404601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:53.405130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.406419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:53.406419 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.406419 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:53.406419 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.406419 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.406419 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:53.406419 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.406419 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:53.407911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:53.408765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:53.408765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.408765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:53.408765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.408765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.408765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:53.408765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.408765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:53.409650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.410544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:53.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:53.564110 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:53.564983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:53.566093 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:53.566279 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:53.566510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.567376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:53.567376 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.567376 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:53.567376 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.567376 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.567376 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:53.567376 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.567376 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.569552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:53.570372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:58.107742 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:58.109434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:58.153293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:58.153504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.154096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:20:58.154096 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.154096 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:58.154096 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.154096 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.154096 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:58.154096 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.154096 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.155205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.155970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:58.305266 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:58.307277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:58.307863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:58.308162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.309341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:20:58.309341 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.309341 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:58.309341 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.309341 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.309341 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:58.309341 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.309341 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:58.311720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.312748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:58.343468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:58.344500 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:20:58.345435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:58.345721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.346755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:20:58.346755 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.346755 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:58.346755 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.346755 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.346755 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:58.346755 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.346755 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:58.348448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.348943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:20:58.349916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.350391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.350924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:58.350924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.350924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:58.403740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:58.404153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:58.405326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:58.405831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.406783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:58.406783 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.406783 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:58.406783 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.406783 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.406783 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:58.406783 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.406783 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:20:58.408109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:58.408863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:20:58.408863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.408863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:20:58.408863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.408863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.408863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:20:58.408863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.408863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:20:58.410596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.411408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:58.412310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.412310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:20:58.565084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:20:58.565376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:20:58.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:58.567041 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:20:58.567340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.568400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:20:58.568400 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.568400 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:20:58.568400 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.568400 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.568400 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:20:58.568400 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.568400 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.570382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:20:58.570972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:03.108436 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:03.109921 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:03.148554 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:03.150942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.152080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:03.152080 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.152080 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:03.152080 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.152080 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.152080 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:03.152080 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.152080 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.153430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.153779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:03.306231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:03.307404 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:03.307581 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:03.307690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.308282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:21:03.308282 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.308282 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:03.308282 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.308282 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.308282 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:03.308282 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.308282 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:03.309114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.309564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:03.344397 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:03.345273 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:03.346238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:03.346621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.348047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:03.348047 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.348047 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:03.348047 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.348047 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.348047 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:03.348047 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.348047 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:03.349580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.350067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:03.351575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.352062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.352578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:03.352578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.352578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:03.404789 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:03.405345 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:03.406427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:03.406825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.407735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:03.407735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.407735 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:03.407735 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.407735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.407735 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:03.407735 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.407735 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:03.409135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:03.409932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:03.409932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.409932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:03.409932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.409932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.409932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:03.409932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.409932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:03.410814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.412260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:03.413633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.413633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:03.565956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:03.566422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:03.567341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:03.567801 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:03.568098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.569078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:03.569078 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.569078 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:03.569078 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.569078 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.569078 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:03.569078 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.569078 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.571531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:03.572312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:08.109213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:08.110679 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:08.146114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:08.146389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.147127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:08.147127 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.147127 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:08.147127 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.147127 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.147127 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:08.147127 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.147127 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.149627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:08.307097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:08.308654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:08.309037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:08.309252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.310321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:08.310321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.310321 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:08.310321 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.310321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.310321 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:08.310321 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.310321 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.312424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.313361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:08.345169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:08.345642 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:08.346734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:08.347243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.348811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:08.348811 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.348811 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:08.348811 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.348811 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.348811 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:08.348811 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.348811 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:08.349924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.350461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:08.351281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.351822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.352435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:08.352435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.352435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:08.405549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:08.406419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:08.407613 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:08.408232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.409420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:08.409420 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.409420 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:08.409420 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.409420 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.409420 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:08.409420 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.409420 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:08.410838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:08.411382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:08.411382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.411382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:08.411382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.411382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.411382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:08.411382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.411382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:08.412042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.412518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:08.413173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.413173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:08.567363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:08.568189 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:08.568793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:08.569293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:08.569613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.570895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:08.570895 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.570895 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:08.570895 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.570895 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.570895 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:08.570895 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.570895 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.572608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:08.573479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:13.110046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:13.111997 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:13.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:13.150306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.150861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:13.150861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.150861 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:13.150861 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.150861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.150861 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:13.150861 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.150861 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.152092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.153160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:13.307835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:13.309418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:13.309816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:13.310132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.311333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:13.311333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.311333 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:13.311333 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.311333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.311333 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:13.311333 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.311333 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.315007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.315704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:13.345816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:13.346213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:13.346716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:13.347007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.348034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:13.348034 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.348034 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:13.348034 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.348034 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.348034 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:13.348034 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.348034 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:13.349547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.350373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:13.351613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.352554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.353489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:13.353489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.353489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:13.406319 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:13.406831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:13.407487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:13.407950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.408499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:13.408499 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.408499 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:13.408499 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.408499 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.408499 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:13.408499 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.408499 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:13.409511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:13.409967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:13.409967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.409967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:13.409967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.409967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.409967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:13.409967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.409967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:13.410633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.411253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:13.411739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.411739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:13.568163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:13.569046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:13.569960 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:13.570408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:13.570613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.571665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:13.571665 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.571665 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:13.571665 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.571665 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.571665 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:13.571665 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.571665 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.573408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:13.574036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:18.110681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:18.113871 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:18.155262 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:18.155722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.157636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:18.157636 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.157636 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:18.157636 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.157636 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.157636 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:18.157636 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.157636 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.157857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.158277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:18.309541 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:18.312108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:18.312302 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:18.312542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.315048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:18.316595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.317015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.317015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:18.317015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.317015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:18.346426 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:18.347049 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:18.347914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:18.348336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.349203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:18.349203 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.349203 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:18.349203 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.349203 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.349203 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:18.349203 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.349203 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:18.349994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:18.350732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.351475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.352352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:18.407051 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:18.407913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:18.410137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:18.410593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.412015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:18.412015 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.412015 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:18.412015 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.412015 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.412015 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:18.412015 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.412015 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:18.413472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.415069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:18.415998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.416665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:18.418109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.418109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:18.569308 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:18.570147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:18.571165 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:18.571648 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:18.571941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.573010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:18.573010 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.573010 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:18.573010 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.573010 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.573010 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:18.573010 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.573010 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.574314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:18.575639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:23.113319 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:23.114494 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:23.162145 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:23.162460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.163827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:23.163827 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.163827 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:23.163827 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.163827 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.163827 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:23.163827 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.163827 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.165075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.165988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:23.311047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:23.313668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:23.314093 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:23.314340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.317399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:23.318296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.318832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.318832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:23.318832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.318832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:23.347101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:23.347754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:23.348364 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:23.348726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.349632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:23.349632 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.349632 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:23.349632 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.349632 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.349632 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:23.349632 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.349632 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:23.350956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.351773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:23.352719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.354732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.355535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:23.355535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.355535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:23.407578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:23.408304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:23.408764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:23.409038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.409734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:23.409734 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.409734 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:23.409734 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.409734 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.409734 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:23.409734 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.409734 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:23.441036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:23.442106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:23.443031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.444159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:23.570068 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:23.570690 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:23.571426 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:23.571746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:23.571966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.572624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:23.572624 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.572624 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:23.572624 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.572624 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.572624 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:23.572624 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.572624 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.574003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:23.576037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:28.114619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:28.116811 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:28.157607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:28.157942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.158799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:28.158799 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.158799 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:28.158799 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.158799 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.158799 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:28.158799 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.158799 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.159959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.160552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:28.312087 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:28.313793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:28.314111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:28.314643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.315594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:28.315594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.315594 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:28.315594 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.315594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.315594 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:28.315594 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.315594 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.316918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.317449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:28.348118 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:28.348825 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:28.349628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:28.350077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.351096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:28.351096 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.351096 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:28.351096 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.351096 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.351096 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:28.351096 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.351096 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:28.352789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.353613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:28.354527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.355344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.356178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:28.356178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.356178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:28.408612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:28.410053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:28.410053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:28.410327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.411138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:28.411138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.411138 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:28.411138 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.411138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.411138 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:28.411138 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.411138 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:28.412221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.412903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:28.413398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.413849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:28.414390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.414390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:28.570961 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:28.571618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:28.572440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:28.572957 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:28.573175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.574050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:28.574050 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.574050 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:28.574050 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.574050 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.574050 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:28.574050 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.574050 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.575816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:28.576646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:33.115810 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:33.117837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:33.153714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:33.153714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.154690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:33.154690 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.154690 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:33.154690 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.154690 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.154690 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:33.154690 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.154690 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.155485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.156201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:33.312764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:33.313952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:33.314128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:33.314246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.314772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:33.314772 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.314772 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:33.314772 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.314772 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.314772 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:33.314772 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.314772 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.315595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.316108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:33.348785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:33.349597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:33.350185 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:33.350448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.351304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:33.351304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.351304 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:33.351304 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.351304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.351304 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:33.351304 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.351304 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:33.352126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.352934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:33.354067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.354853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.355712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:33.355712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.355712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:33.409286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:33.410140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:33.411227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:33.411699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.413021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:33.413021 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.413021 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:33.413021 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.413021 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.413021 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:33.413021 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.413021 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:33.414094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.414532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:33.415501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.415987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:33.416501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.416501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:33.571787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:33.573754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:33.574428 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:33.574818 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:33.575032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.575728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:33.575728 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.575728 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:33.575728 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.575728 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.575728 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:33.575728 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.575728 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.576789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:33.577591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:38.116695 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:38.118664 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:38.154537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:38.154898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.155711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:38.155711 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.155711 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:38.155711 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.155711 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.155711 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:38.155711 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.155711 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.156760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.157727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:38.313609 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:38.315102 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:38.315497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:38.315759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.316803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:38.316803 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.316803 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:38.316803 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.316803 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.316803 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:38.316803 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.316803 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.318227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.318766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:38.349350 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:38.350011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:38.350527 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:38.350760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.351434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:38.351434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.351434 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:38.351434 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.351434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.351434 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:38.351434 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.351434 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:38.355282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.356219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:38.356996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.357826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.358745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:38.358745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.358745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:38.410388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:38.411061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:38.411838 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:38.412487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.413257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:38.413257 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.413257 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:38.413257 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.413257 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.413257 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:38.413257 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.413257 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:38.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.415059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:38.416400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.417197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:38.418055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.418055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:38.573832 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:38.574479 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:38.575250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:38.575783 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:38.576074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.576958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:38.576958 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.576958 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:38.576958 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.576958 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.576958 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:38.576958 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.576958 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.578529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:38.579033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:43.117674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:43.119780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:43.122571 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=257 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:21:43.158380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:43.158910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.159979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:43.159979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.159979 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:43.159979 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.159979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.159979 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:43.159979 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.159979 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.161294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.162024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:43.314359 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:43.316324 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:43.316806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:43.317239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.318542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:43.318542 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.318542 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:43.318542 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.318542 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.318542 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:43.318542 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.318542 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.320693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.321217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:43.350004 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:43.350788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:43.351428 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:43.351732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.352600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:43.352600 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.352600 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:43.352600 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.352600 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.352600 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:43.352600 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.352600 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:43.354375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.354863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:43.356415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.356968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.357832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:43.357832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.357832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:43.411194 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:43.411740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:43.412432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:43.412777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.413676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:43.413676 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.413676 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:43.413676 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.413676 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.413676 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:43.413676 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.413676 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:43.415163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.415661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:43.416873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.417358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:43.417871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.417871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:43.574355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:43.575114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:43.575728 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:43.576034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:43.576336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.577294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:43.577294 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.577294 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:43.577294 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.577294 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.577294 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:43.577294 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.577294 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.579226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:43.580035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:48.118607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:48.120503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:48.166165 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:48.166473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.167345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:48.167345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.167345 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:48.167345 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.167345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.167345 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:48.167345 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.167345 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.168502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.169601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:48.315140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:48.316505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:48.316705 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:48.316945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.317588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:48.317588 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.317588 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:48.317588 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.317588 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.317588 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:48.317588 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.317588 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.319670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.320663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:48.350643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:48.351540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:48.352687 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:48.353237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.354445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:48.354445 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.354445 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:48.354445 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.354445 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.354445 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:48.354445 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.354445 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:48.356013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.356406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:48.357215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.357550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.357912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:48.357912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.357912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:48.411822 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:48.412481 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:48.413599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:48.414166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.415694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:48.415694 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.415694 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:48.415694 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.415694 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.415694 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:48.415694 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.415694 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:48.417579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.418352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:48.419294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.420096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:48.421053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.421053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:48.575272 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:48.575974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:48.577228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:48.577532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:48.577680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.578322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:48.578322 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.578322 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:48.578322 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.578322 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.578322 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:48.578322 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.578322 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.579608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:48.580547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:53.119255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:53.122479 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:53.156111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:53.156817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.157593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:53.157593 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.157593 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:53.157593 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.157593 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.157593 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:53.157593 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.157593 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.158577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.159191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:53.316099 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:53.317688 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:53.318061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:53.318278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.319350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:53.319350 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.319350 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:53.319350 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.319350 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.319350 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:53.319350 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.319350 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.320527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.321119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:53.351522 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:53.352222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:53.352890 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:53.353318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.354148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:53.354148 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.354148 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:53.354148 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.354148 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.354148 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:53.354148 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.354148 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:53.355220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.356099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:53.356766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.357511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.358311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:53.358311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.358311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:53.412446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:53.415341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:53.415341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:53.415341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.415625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:53.415625 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.415625 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:53.415625 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.415625 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.415625 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:53.415625 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.415625 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:53.417408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.417953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:53.419132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.419698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:53.420432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.420432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:53.576030 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:53.579460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:53.580373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:53.580718 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:53.580915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.581781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:53.581781 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.581781 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:53.581781 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.581781 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.581781 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:53.581781 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.581781 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.584168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:53.586171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:58.120108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:58.121866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:58.156706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:58.157505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.157865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:21:58.157865 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.157865 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:58.157865 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.157865 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.157865 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:58.157865 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.157865 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.159298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.159976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:58.317149 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:58.319277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:58.319676 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:58.320118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.321057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:58.321057 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.321057 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:58.321057 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.321057 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.321057 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:58.321057 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.321057 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.323099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.323717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:58.352195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:58.352872 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:21:58.353651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:58.354138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.355299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:21:58.355299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.355299 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:58.355299 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.355299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.355299 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:58.355299 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.355299 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:58.356702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.357543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:21:58.358476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.359507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.360356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:58.360356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.360356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:58.414123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:58.414617 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:58.415535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:58.415903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.417196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:21:58.417196 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.417196 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:58.417196 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.417196 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.417196 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:58.417196 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.417196 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:21:58.418479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.419222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:21:58.419898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.420902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:58.421798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.421798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:21:58.579460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:21:58.579961 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:21:58.580903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:58.581624 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:21:58.581953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.583089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:21:58.583089 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.583089 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:21:58.583089 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.583089 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.583089 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:21:58.583089 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.583089 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.584456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:21:58.585219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:03.121050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:03.122829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:03.165946 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:03.166493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.167551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:03.167551 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.167551 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:03.167551 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.167551 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.167551 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:03.167551 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.167551 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.169110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.169520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:03.323330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:03.324709 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:03.325159 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:03.325261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.326170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:03.326170 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.326170 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:03.326170 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.326170 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.326170 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:03.326170 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.326170 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.327930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.328280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:03.352623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:03.353390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:03.354154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:03.354536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.355789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:03.355789 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.355789 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:03.355789 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.355789 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.355789 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:03.355789 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.355789 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:03.357427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.358265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:03.358845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.359349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.359986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:03.359986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.359986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:03.414460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:03.414927 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:03.415988 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:03.416402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.417436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:03.417436 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.417436 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:03.417436 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.417436 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.417436 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:03.417436 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.417436 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:03.418895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.419602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:03.420554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.421289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:03.422170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.422170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:03.580190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:03.580543 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:03.581160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:03.581662 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:03.581912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.582666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:03.582666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.582666 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:03.582666 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.582666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.582666 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:03.582666 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.582666 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.584182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:03.584920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:08.121753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:08.123630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:08.161759 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:08.162216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.163235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:08.163235 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.163235 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:08.163235 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.163235 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.163235 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:08.163235 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.163235 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.164516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.165246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:08.323992 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:08.325216 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:08.325619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:08.325898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.327281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:08.327281 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.327281 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:08.327281 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.327281 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.327281 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:08.327281 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.327281 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.329220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.330007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:08.353240 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:08.353761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:08.354399 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:08.354673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.355513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:08.355513 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.355513 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:08.355513 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.355513 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.355513 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:08.355513 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.355513 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:08.356859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.357571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:08.358771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.359336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.359838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:08.359838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.359838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:08.415067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:08.415682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:08.416782 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:08.417250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.419704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:08.419704 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.419704 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:08.419704 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.419704 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.419704 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:08.419704 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.419704 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:08.420668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.421122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:08.422089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.422558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:08.423095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.423095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:08.580731 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:08.581441 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:08.582281 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:08.582776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:08.582992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.584054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:08.584054 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.584054 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:08.584054 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.584054 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.584054 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:08.584054 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.584054 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.585245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:08.586074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:13.122505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:13.123795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:13.165079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:13.165850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.166534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:13.166534 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.166534 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:13.166534 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.166534 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.166534 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:13.166534 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.166534 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.167674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.168838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:13.324570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:13.326366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:13.326692 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:13.326848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.327684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:13.327684 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.327684 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:13.327684 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.327684 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.327684 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:13.327684 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.327684 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.329268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.329934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:13.353804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:13.354381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:13.354963 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:13.355334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.356116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:13.356116 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.356116 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:13.356116 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.356116 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.356116 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:13.356116 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.356116 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:13.357119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.357827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:13.358352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.359058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.359818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:13.359818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.359818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:13.415621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:13.416020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:13.416537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:13.416998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.417886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:13.417886 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.417886 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:13.417886 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.417886 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.417886 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:13.417886 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.417886 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.419646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:13.421119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.421595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:13.422103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.422103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:13.581525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:13.582239 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:13.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:13.583298 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:13.583458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.584179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:13.584179 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.584179 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:13.584179 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.584179 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.584179 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:13.584179 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.584179 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.585470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:13.586706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:18.123306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:18.124835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:18.163274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.164446 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.166160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.167573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:18.326026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.328107 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.329448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.330973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:18.354451 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:18.354983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:18.355475 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:18.355723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.356396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:18.356396 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.356396 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:18.356396 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.356396 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.356396 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:18.356396 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.356396 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:18.356988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:18.358227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.358869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.359599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:18.416286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:18.417059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:18.417615 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:18.417948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.418527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:18.418527 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.418527 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:18.418527 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.418527 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.418527 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:18.418527 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.418527 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:18.419584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.420033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:18.420690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.421105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:18.421783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.421783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:18.582324 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:18.582614 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:18.583323 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:18.583649 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:18.584132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.584627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:18.584627 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.584627 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:18.584627 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.584627 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.584627 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:18.584627 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.584627 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.586303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:18.586898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:23.123955 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:23.127711 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:23.164447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:23.164765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:23.166532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:23.167590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.168468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:23.168468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.168468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.168468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:23.168468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.168468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:23.326066 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:23.327474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:23.327828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:23.327828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.328497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:23.328497 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.328497 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:23.328497 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.328497 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.328497 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:23.328497 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.328497 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.329464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.330299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:23.355206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:23.355766 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:23.357287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:23.357569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.358365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:23.358365 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.358365 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:23.358365 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.358365 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.358365 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:23.358365 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.358365 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:23.359202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.360022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:23.360288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.361671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.362194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:23.362194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.362194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:23.417313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:23.417790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:23.418634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:23.419169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.420050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:23.420050 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.420050 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:23.420050 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.420050 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.420050 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:23.420050 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.420050 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:23.420818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.421267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:23.421625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.422293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:23.422798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.422798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:23.584013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:23.584013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:23.584321 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:23.584819 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:23.585094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.587628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:23.589312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:23.589987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:23.589987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:23.589987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:23.589987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:28.124826 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:28.126502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:28.168800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:28.169275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.170452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:28.170452 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.170452 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:28.170452 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.170452 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.170452 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:28.170452 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.170452 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.171490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.171905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:28.326999 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:28.328961 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:28.329340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:28.329616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.330545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:28.330545 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.330545 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:28.330545 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.330545 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.330545 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:28.330545 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.330545 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.332746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.333310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:28.355867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:28.356658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:28.357297 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:28.357589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.358508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:28.358508 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.358508 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:28.358508 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.358508 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.358508 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:28.358508 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.358508 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:28.360000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.360912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:28.361320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.362789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:28.362789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.362789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:28.417955 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:28.418580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:28.419345 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:28.419677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.422210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:28.422210 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.422210 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:28.422210 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.422210 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.422210 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:28.422210 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.422210 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:28.423242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.424089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:28.424562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.425273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:28.426121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.426121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:28.583860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:28.584591 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:28.585300 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:28.585629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:28.585810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.586524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:28.586524 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.586524 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:28.586524 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.586524 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.586524 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:28.586524 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.586524 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.588992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:28.589750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:33.125636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:33.127140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:33.165726 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:33.166218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:33.172548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:33.173260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.173772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:33.173772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.173772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.173772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:33.173772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.173772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:33.328711 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.358028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.358640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:33.359190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.359621 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:33.360017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.360474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:33.361053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.361551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.362178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:33.362178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.362178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:33.418731 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:33.419239 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:33.420227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:33.420663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.421738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:33.421738 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.421738 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:33.421738 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.421738 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.421738 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:33.421738 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.421738 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:33.423318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.424014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:33.425170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.426068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:33.427061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.427061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:33.584610 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:33.585303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:33.585957 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:33.586394 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:33.586688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.587613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:33.587613 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.587613 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:33.587613 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.587613 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.587613 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:33.587613 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.587613 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.589016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:33.590048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:38.126344 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:38.128244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:38.165297 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:38.165690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.166496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:38.166496 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.166496 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:38.166496 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.166496 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.166496 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:38.166496 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.166496 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.167370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.167978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:38.329546 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:38.331761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:38.332082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:38.332082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.332909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:38.332909 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.332909 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:38.332909 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.332909 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.332909 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:38.332909 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.332909 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.334204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.335429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:38.357540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:38.358524 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:38.359205 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:38.359619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.360511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:38.360511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.360511 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:38.360511 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.360511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.360511 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:38.360511 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.360511 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:38.362019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.362479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:38.363985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.364432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.364853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:38.364853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.364853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:38.419475 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:38.420189 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:38.421382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:38.422015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.423131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:38.423131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.423131 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:38.423131 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.423131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.423131 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:38.423131 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.423131 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:38.424529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.425386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:38.426777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.427392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:38.427915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.427915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:38.585426 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:38.586137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:38.586868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:38.587595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:38.588038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.589070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:38.589070 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.589070 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:38.589070 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.589070 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.589070 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:38.589070 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.589070 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.590034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:38.590509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:43.127011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:43.128210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:43.140115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=241 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:22:43.175783 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:43.176185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.177173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:43.177173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.177173 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:43.177173 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.177173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.177173 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:43.177173 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.177173 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.178283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.178905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:43.330531 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:43.331833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:43.332380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:43.332654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.333677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:43.333677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.333677 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:43.333677 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.333677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.333677 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:43.333677 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.333677 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.335062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.335597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:43.358320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:43.358949 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:43.359610 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:43.360037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.360748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:22:43.360748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.360748 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:43.360748 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.360748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.360748 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:43.360748 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.360748 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:43.361422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.362001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:43.362289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.362772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.363362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:43.363362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.363362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:43.420400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:43.421200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:43.422175 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:43.422643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.423656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:43.423656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.423656 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:43.423656 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.423656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.423656 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:43.423656 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.423656 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:43.424734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.425305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:43.425793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.426447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:43.426990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.426990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:43.586235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:43.586980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:43.589540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:43.589978 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:43.590167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.591426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:43.591426 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.591426 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:43.591426 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.591426 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.591426 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:43.591426 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.591426 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.592715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:43.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:48.127732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:48.129601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:48.173280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:48.173731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.174744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:48.174744 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.174744 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:48.174744 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.174744 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.174744 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:48.174744 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.174744 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.175749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.176392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:48.331181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:48.332232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:48.332470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:48.332620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.333338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:48.333338 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.333338 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:48.333338 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.333338 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.333338 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:48.333338 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.333338 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.334334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.335323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:48.380775 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:48.381170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:48.382619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:48.382898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.383802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:22:48.383802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.383802 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:48.383802 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.383802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.383802 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:48.383802 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.383802 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:48.385521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.385873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:48.386384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.386726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.387085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:48.387085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.387085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:48.421089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:48.422959 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.425721 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:48.426793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:48.429102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.429461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:48.429824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.429824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:48.586945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:48.587648 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:48.588565 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:48.588891 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:48.589110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.589845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:48.589845 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.589845 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:48.589845 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.589845 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.589845 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:48.589845 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.589845 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.591324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:48.591897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:53.129040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:53.130296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:53.167299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:53.167661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.168706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:53.168706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.168706 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:53.168706 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.168706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.168706 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:53.168706 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.168706 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.170262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.171299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:53.331720 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:53.333159 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:53.333474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:53.333657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.334738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:53.334738 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.334738 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:53.334738 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.334738 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.334738 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:53.334738 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.334738 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.337013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.337392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:53.382431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:53.383312 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:53.385914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:53.387113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.388621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:53.388621 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.388621 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:53.388621 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.388621 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.388621 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:53.388621 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.388621 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:53.389667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:53.390326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:53.390326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.390326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:53.390326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.390326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.390326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:53.390326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.390326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:53.391175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.391868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.392769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:53.392769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.392769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:53.422910 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:53.423535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:53.424499 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:53.424839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.426069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:53.426069 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.426069 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:53.426069 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.426069 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.426069 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:53.426069 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.426069 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:53.428863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:53.429349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:53.429794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.430343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:53.587675 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:53.588435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:53.589233 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:53.589902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:53.590369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.591272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:53.591272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.591272 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:53.591272 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.591272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.591272 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:53.591272 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.591272 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.592275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:53.593001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:58.129224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:58.130454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:58.171340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:58.171917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.173760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:22:58.173760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.173760 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:58.173760 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.173760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.173760 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:58.173760 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.173760 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.174805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.175495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:58.332483 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:58.334118 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:58.334350 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:58.334689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.336483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:58.337232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.337753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.337753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:58.337753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.337753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:58.383294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:58.383762 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:22:58.384892 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:58.386019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.386674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:22:58.386674 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.386674 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:58.386674 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.386674 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.386674 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:58.386674 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.386674 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:58.387622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.388386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:22:58.389009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.390129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.390670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:58.390670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.390670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:58.423538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:58.424142 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:58.425003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:58.425317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.426094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:22:58.426094 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.426094 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:58.426094 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.426094 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.426094 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:58.426094 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.426094 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:22:58.427068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.427630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:22:58.428254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.428867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:58.429691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.429691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:22:58.588322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:22:58.588932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:22:58.589819 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:58.590301 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:22:58.590435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.591243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:22:58.591243 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.591243 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:22:58.591243 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.591243 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.591243 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:22:58.591243 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.591243 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.592186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:22:58.593118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:03.130259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:03.133673 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:03.191233 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:03.191687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.192310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:03.192310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.192310 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:03.192310 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.192310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.192310 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:03.192310 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.192310 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.194100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.194706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:03.333388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:03.335335 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:03.335579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:03.335742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.336612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:03.336612 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.336612 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:03.336612 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.336612 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.336612 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:03.336612 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.336612 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.338392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.338940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:03.384003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:03.384625 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:03.385925 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:03.385925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.386286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:03.386286 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.386286 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:03.386286 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.386286 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.386286 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:03.386286 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.386286 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:03.388512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:03.389217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:03.389217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.389217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:03.389217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.389217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.389217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:03.389217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.389217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:03.393245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.393811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.394338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:03.394338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.394338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:03.424325 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:03.424982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:03.426927 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:03.426927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.427163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:03.427163 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.427163 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:03.427163 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.427163 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.427163 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:03.427163 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.427163 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:03.427949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.428345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:03.428758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.429187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:03.429855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.429855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:03.589103 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:03.589435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:03.591091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:03.591091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:03.591091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.592080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:03.592080 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.592080 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:03.592080 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.592080 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.592080 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:03.592080 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.592080 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.593284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:03.594177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:08.131417 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:08.132969 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:08.173509 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:08.173509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.173865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:08.173865 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.173865 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:08.173865 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.173865 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.173865 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:08.173865 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.173865 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.175130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.175670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:08.334685 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:08.337652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:08.337652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:08.337652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.338147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:08.338147 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.338147 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:08.338147 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.338147 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.338147 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:08.338147 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.338147 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.340326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.340918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:08.384704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:08.385342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:08.387124 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:08.387124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.387361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:08.387361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.387361 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:08.387361 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.387361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.387361 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:08.387361 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.387361 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:08.388857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:08.389369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:08.389369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.389369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:08.389369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.389369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.389369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:08.389369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.389369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:08.390507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.391188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.391695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:08.391695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.391695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:08.425084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:08.425480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:08.427264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:08.427264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.427436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:08.427436 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.427436 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:08.427436 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.427436 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.427436 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:08.427436 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.427436 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:08.428187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.428622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:08.429105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.429579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:08.430147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.430147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:08.589771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:08.590448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:08.592548 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:08.592548 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:08.592548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.592741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:08.592741 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.592741 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:08.592741 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.592741 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.592741 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:08.592741 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.592741 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.594093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:08.594663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:13.132349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:13.134077 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:13.180847 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:13.181148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.182039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:13.182039 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.182039 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:13.182039 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.182039 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.182039 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:13.182039 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.182039 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.183381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.183906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:13.335840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:13.337230 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:13.337552 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:13.337729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.338837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:13.338837 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.338837 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:13.338837 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.338837 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.338837 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:13.338837 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.338837 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:13.340734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.341244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:13.385562 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:13.386258 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:13.387619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:13.387683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.389083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:13.389083 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.389083 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:13.389083 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.389083 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.389083 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:13.389083 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.389083 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:13.390099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:13.390549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:13.390549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.390549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:13.390549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.390549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.390549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:13.390549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.390549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:13.391432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.391910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.392437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:13.392437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.392437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:13.425626 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:13.426315 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:13.426924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:13.427192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.427737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:13.427737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.427737 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:13.427737 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.427737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.427737 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:13.427737 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.427737 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:13.428611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.429162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:13.429544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.430016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:13.430602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.430602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:13.590457 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:13.591040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:13.591704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:13.592000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:13.592165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.592791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:13.592791 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.592791 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:13.592791 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.592791 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.592791 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:13.592791 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.592791 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.593717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:13.594261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:18.133223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:18.136105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:18.194349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:18.194950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.196038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:18.196038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.196038 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:18.196038 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.196038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.196038 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:18.196038 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.196038 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.197308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.197942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:18.336558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:18.337860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:18.338082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:18.338334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.339750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:18.339750 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.339750 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:18.339750 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.339750 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.339750 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:18.339750 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.339750 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:18.340809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.341418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:18.386504 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:18.386800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.388929 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:18.389503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.390065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:18.390744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.391293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.391712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:18.391712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.391712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:18.426362 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:18.427004 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:18.427679 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:18.428082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.432175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:18.432175 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.432175 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:18.432175 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.432175 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.432175 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:18.432175 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.432175 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:18.433424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.434513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:18.435112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.436023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:18.436864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.436864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:18.591281 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:18.592025 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:18.592794 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:18.593255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:18.593554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.596098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:18.596098 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.596098 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:18.596098 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.596098 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.596098 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:18.596098 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.596098 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.597131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:18.598000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:23.134707 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:23.136260 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:23.196712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:23.196981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.197845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:23.197845 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.197845 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:23.197845 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.197845 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.197845 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:23.197845 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.197845 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.199205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.199767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:23.337617 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:23.338910 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:23.339236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:23.339398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.340345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:23.340345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.340345 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:23.340345 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.340345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.340345 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:23.340345 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.340345 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:23.341461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.342036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:23.386981 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:23.387666 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:23.388535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:23.388820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.390235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:23:23.390235 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.390235 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:23.390235 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.390235 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.390235 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:23.390235 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.390235 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:23.392054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.392774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:23.393728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.394679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.395360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:23.395360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.395360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:23.427117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:23.427900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:23.428777 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:23.429169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.430145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:23.430145 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.430145 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:23.430145 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.430145 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.430145 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:23.430145 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.430145 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:23.431855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.432677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:23.433786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.434590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:23.435654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.435654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:23.592012 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:23.594948 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:23.595214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:23.595525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:23.595701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.596679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:23.596679 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.596679 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:23.596679 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.596679 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.596679 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:23.596679 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.596679 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.598145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:23.598564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:28.135505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:28.137271 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:28.171493 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:28.172022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.172808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:28.172808 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.172808 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:28.172808 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.172808 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.172808 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:28.172808 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.172808 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.173757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.174155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:28.338523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:28.340252 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:28.340593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:28.340797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.341751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:28.341751 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.341751 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:28.341751 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.341751 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.341751 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:28.341751 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.341751 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:28.343736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.344716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:28.387868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:28.388377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:28.389177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:28.389446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.390220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:23:28.390220 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.390220 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:28.390220 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.390220 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.390220 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:28.390220 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.390220 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:28.391280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.392004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:28.392396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.392970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.393510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:28.393510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.393510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:28.427750 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:28.428136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:28.428953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:28.429378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.430304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:28.430304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.430304 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:28.430304 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.430304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.430304 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:28.430304 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.430304 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:28.431126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:28.432073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:28.432728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.433583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:28.596031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:28.596945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:28.599667 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:28.600491 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:28.600491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.601000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:28.601000 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.601000 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:28.601000 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.601000 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.601000 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:28.601000 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.601000 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.602429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:28.602999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:33.136244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:33.137413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:33.176106 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:33.176476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.177707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:33.177707 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.177707 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:33.177707 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.177707 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.177707 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:33.177707 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.177707 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.179165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.180057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:33.339242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:33.340668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:33.341368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:33.341368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.342115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:33.342115 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.342115 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:33.342115 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.342115 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.342115 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:33.342115 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.342115 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:33.343436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.344532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:33.388759 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:33.390499 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:33.391712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:33.392013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.392940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:33.392940 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.392940 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:33.392940 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.392940 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.392940 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:33.392940 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.392940 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:33.393813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:33.394492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:33.394492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.394492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:33.394492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.394492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.394492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:33.394492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.394492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:33.394970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.395559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.396169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:33.396169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.396169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:33.429536 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:33.430224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:33.430739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:33.430956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.431718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:33.431718 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.431718 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:33.431718 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.431718 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.431718 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:33.431718 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.431718 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:33.432287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.432738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:33.433289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.434510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:33.435097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.435097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:33.596830 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:33.597471 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:33.599941 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:33.600127 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:33.600289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.601133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:33.601133 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.601133 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:33.601133 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.601133 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.601133 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:33.601133 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.601133 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.603044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:33.603543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:38.139553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:38.142586 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:38.180342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:38.180702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.181553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:38.181553 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.181553 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:38.181553 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.181553 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.181553 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:38.181553 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.181553 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.182559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.183385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:38.340112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:38.341506 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:38.341893 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:38.342265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.343251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:38.343251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.343251 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:38.343251 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.343251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.343251 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:38.343251 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.343251 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:38.344600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.345124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:38.390967 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:38.391550 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:38.392612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:38.392996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.393869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:23:38.393869 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.393869 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:38.393869 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.393869 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.393869 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:38.393869 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.393869 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:38.394955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.395389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:38.396390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.396835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.397353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:38.397353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.397353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:38.430463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:38.431023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:38.431578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:38.431904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.432633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:38.432633 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.432633 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:38.432633 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.432633 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.432633 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:38.432633 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.432633 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:38.433510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.434292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:38.435134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.435692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:38.436401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.436401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:38.597492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:38.598068 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:38.599016 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:38.599479 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:38.599701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.600606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:38.600606 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.600606 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:38.600606 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.600606 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.600606 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:38.600606 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.600606 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.602064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:38.602722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:43.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:43.141794 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:43.148151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:23:43.181637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:43.181895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.183018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:43.183018 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.183018 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:43.183018 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.183018 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.183018 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:43.183018 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.183018 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.184479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.185055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:43.341129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:43.342773 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:43.343291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:43.343291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.344654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:43.344654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.344654 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:43.344654 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.344654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.344654 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:43.344654 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.344654 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:43.348553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.349322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:43.391954 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:43.392422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:43.393155 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:43.393438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.394456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:43.394456 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.394456 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:43.394456 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.394456 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.394456 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:43.394456 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.394456 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:43.395680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:43.396510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:43.396510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.396510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:43.396510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.396510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.396510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:43.396510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.396510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:43.397198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.397929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.398814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:43.398814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.398814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:43.431302 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:43.431840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:43.432594 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:43.432914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.434077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:43.434077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.434077 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:43.434077 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.434077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.434077 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:43.434077 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.434077 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:43.435752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.436596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:43.437792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.438444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:43.439016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.439016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:43.598964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:43.598964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:43.600832 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:43.600832 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:43.600832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.601141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:43.601141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.601141 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:43.601141 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.601141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.601141 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:43.601141 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.601141 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.602475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:43.603022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:48.141924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:48.144432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:48.186127 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:48.186841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.187563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:48.187563 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.187563 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:48.187563 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.187563 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.187563 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:48.187563 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.187563 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.188570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.189080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:48.341901 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:48.343549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:48.343972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:48.344218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.345430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:48.345430 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.345430 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:48.345430 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.345430 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.345430 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:48.345430 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.345430 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:48.347366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.348012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:48.392749 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:48.393261 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:48.394230 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:48.394618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.395364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:48.395364 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.395364 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:48.395364 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.395364 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.395364 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:48.395364 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.395364 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:48.396142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:48.396907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:48.396907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.396907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:48.396907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.396907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.396907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:48.396907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.396907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:48.397263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.397934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.398721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:48.398721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.398721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:48.432137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:48.432922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:48.433655 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:48.434808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.435638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:48.435638 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.435638 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:48.435638 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.435638 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.435638 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:48.435638 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.435638 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:48.437098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.437815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:48.439048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.439751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:48.440275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.440275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:48.599063 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:48.599797 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:48.600146 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:48.600464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:48.600637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.601631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:48.601631 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.601631 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:48.601631 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.601631 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.601631 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:48.601631 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.601631 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.602569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:48.603497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:53.143020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:53.144650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:53.192528 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:53.192899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.194248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:53.194248 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.194248 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:53.194248 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.194248 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.194248 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:53.194248 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.194248 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.195216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.196223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:53.342618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:53.343966 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:53.344274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:53.344440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.345492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:53.345492 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.345492 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:53.345492 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.345492 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.345492 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:53.345492 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.345492 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:53.347521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.348196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:53.393690 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:53.394157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:53.394851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:53.395274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.396297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:53.396297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.396297 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:53.396297 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.396297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.396297 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:53.396297 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.396297 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:53.397131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:53.397932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:53.397932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.397932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:53.397932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.397932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.397932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:53.397932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.397932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:53.398302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.399215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.400224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:53.400224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.400224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:53.432762 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:53.433166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:53.434163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:53.434526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.435405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:53.435405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.435405 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:53.435405 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.435405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.435405 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:53.435405 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.435405 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:53.436695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.437250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:53.438274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.438828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:53.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:53.599851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:53.600556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:53.601284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:53.601592 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:53.601768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.602528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:53.602528 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.602528 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:53.602528 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.602528 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.602528 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:53.602528 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.602528 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.603798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:53.604353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:58.143731 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:58.144982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:58.186651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:58.186913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.187643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:23:58.187643 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.187643 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:58.187643 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.187643 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.187643 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:58.187643 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.187643 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.189037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.189473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:58.343366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:58.344846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:58.345176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:58.345361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.346311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:23:58.346311 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.346311 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:58.346311 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.346311 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.346311 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:58.346311 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.346311 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:58.347555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.347959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:58.394692 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:58.395604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:23:58.396619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.398280 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:58.399595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:58.400312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:58.400312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.400312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:58.400312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.400312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.400312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:58.400312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.400312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:23:58.401622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.402287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.402992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:58.402992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.402992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:58.433462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:58.434221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:58.435017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:58.435486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.436612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:23:58.436612 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.436612 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:58.436612 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.436612 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.436612 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:58.436612 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.436612 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:23:58.437651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.438020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:23:58.438523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.439002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:58.439366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.439366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:23:58.600653 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:23:58.601294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:23:58.602204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:58.602645 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:23:58.602900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.604171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:23:58.604171 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.604171 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:23:58.604171 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.604171 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.604171 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:23:58.604171 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.604171 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.606588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:23:58.607102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:03.144726 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:03.146764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:03.185256 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:03.185515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.186228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:03.186228 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.186228 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:03.186228 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.186228 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.186228 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:03.186228 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.186228 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.187186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.188296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:03.344194 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:03.346172 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:03.346729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:03.346928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.348301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:03.348301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.348301 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:03.348301 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.348301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.348301 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:03.348301 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.348301 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:03.350566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.351045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:03.396050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:03.396050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:03.397116 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:03.397542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.398567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:03.398567 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.398567 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:03.398567 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.398567 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.398567 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:03.398567 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.398567 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:03.400188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:03.401309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:03.401309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.401309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:03.401309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.401309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.401309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:03.401309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.401309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:03.402037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.402572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.403184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:03.403184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.403184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:03.434314 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:03.434845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:03.435643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:03.436017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.436851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:24:03.436851 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.436851 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:03.436851 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.436851 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.436851 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:03.436851 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.436851 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:03.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.438777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:03.440042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.440523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:03.441087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.441087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:03.601576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:03.602502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:03.603323 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:03.603668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:03.603914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.604783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:03.604783 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.604783 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:03.604783 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.604783 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.604783 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:03.604783 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.604783 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.606611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:03.607919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:08.145559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:08.149664 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:08.190978 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:08.191281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.192312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:08.192312 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.192312 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:08.192312 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.192312 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.192312 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:08.192312 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.192312 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.194040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.194593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:08.345125 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:08.346719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:08.347065 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:08.347228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.348363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:08.348363 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.348363 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:08.348363 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.348363 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.348363 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:08.348363 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.348363 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:08.350260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.350749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:08.398818 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:08.399294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:08.401537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:08.401795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.402608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:08.402608 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.402608 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:08.402608 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.402608 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.402608 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:08.402608 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.402608 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:08.404043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:08.405155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:08.405155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.405155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:08.405155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.405155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.405155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:08.405155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.405155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:08.407665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.408188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.408676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:08.408676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.408676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:08.434907 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:08.435542 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:08.436525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:08.437247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.438006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:24:08.438006 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.438006 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:08.438006 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.438006 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.438006 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:08.438006 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.438006 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:08.439254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.440012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:08.440439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.441276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:08.442216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.442216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:08.602388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:08.603030 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:08.603864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:08.604211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:08.604394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.605092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:08.605092 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.605092 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:08.605092 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.605092 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.605092 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:08.605092 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.605092 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.606157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:08.606699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:13.146698 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:13.148148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:13.184180 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:13.184643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.185691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:13.185691 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.185691 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:13.185691 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.185691 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.185691 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:13.185691 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.185691 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.186705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.187658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:13.345649 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:13.348915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:13.349108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:13.349269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.350805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:13.350805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.350805 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:13.350805 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.350805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.350805 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:13.350805 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.350805 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:13.352968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.353656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:13.399282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:13.401417 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:13.402251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:13.402811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.403968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:24:13.403968 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.403968 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:13.403968 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.403968 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.403968 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:13.403968 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.403968 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:13.404427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.404960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:13.405230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.405743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.406303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:13.406303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.406303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:13.435682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:13.436490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:13.436810 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:13.437173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:13.439183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.440283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:13.440661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.441139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:13.603291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:13.603829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:13.604561 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:13.605220 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:13.605529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.606269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:13.606269 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.606269 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:13.606269 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.606269 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.606269 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:13.606269 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.606269 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.607577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:13.608119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:18.149137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:18.149677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:18.202568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:18.202870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.203856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:18.203856 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.203856 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:18.203856 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.203856 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.203856 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:18.203856 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.203856 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.205223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.206188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:18.346363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:18.347523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:18.347833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:18.348009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.348911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:18.348911 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.348911 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:18.348911 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.348911 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.348911 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:18.348911 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.348911 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:18.350224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.350841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:18.401402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:18.401909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:18.402320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:18.402513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.403042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:24:18.403042 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.403042 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:18.403042 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.403042 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.403042 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:18.403042 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.403042 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:18.403612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:18.404392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.405429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.406696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:18.436604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:18.437293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:18.437930 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:18.438187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.438761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:18.438761 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.438761 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:18.438761 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.438761 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.438761 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:18.438761 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.438761 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:18.439482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.440722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:18.441909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.442944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:18.604174 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:18.604799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:18.605505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:18.605742 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:18.605890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.607318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:18.607318 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.607318 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:18.607318 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.607318 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.607318 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:18.607318 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.607318 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.609054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:18.609645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:23.148506 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:23.149567 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:23.189542 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:23.189780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.190602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:23.190602 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.190602 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:23.190602 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.190602 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.190602 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:23.190602 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.190602 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.191832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.193609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:23.346906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:23.348339 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:23.348777 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:23.349123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.350385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:23.350385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.350385 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:23.350385 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.350385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.350385 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:23.350385 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.350385 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:23.351712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.352093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:23.402168 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:23.402781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:23.403501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.405299 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:23.405971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.406764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:23.407213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.407649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.408151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:23.408151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.408151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:23.437471 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:23.438222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:23.438954 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:23.439313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.440421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:23.440421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.440421 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:23.440421 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.440421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.440421 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:23.440421 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.440421 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:23.441556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:23.442347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:23.442347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.442347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:23.442347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.442347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.442347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:23.442347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.442347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:23.443372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.444079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:23.444496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.444496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:23.604828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:23.605585 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:23.606375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:23.606859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:23.606859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.607434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:23.607434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.607434 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:23.607434 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.607434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.607434 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:23.607434 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.607434 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.608604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:23.609206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:28.149213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:28.151225 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:28.190423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:28.190621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.191126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:28.191126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.191126 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:28.191126 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.191126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.191126 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:28.191126 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.191126 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.194045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.195186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:28.348277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:28.349644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:28.349956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:28.350139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.350984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:28.350984 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.350984 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:28.350984 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.350984 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.350984 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:28.350984 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.350984 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:28.352209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.352788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:28.402945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:28.403477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:28.404336 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:28.404635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.405490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:24:28.405490 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.405490 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:28.405490 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.405490 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.405490 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:28.405490 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.405490 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:28.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.407027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:28.407857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.408270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.408684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:28.408684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.408684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:28.438503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:28.439068 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:28.439831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:28.440124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.440750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:24:28.440750 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.440750 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:28.440750 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.440750 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.440750 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:28.440750 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.440750 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:28.442264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.442710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:28.443234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.443731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:28.444298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.444298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:28.606039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:28.606742 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:28.607772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:28.608935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:28.608935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.609358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:28.609358 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.609358 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:28.609358 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.609358 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.609358 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:28.609358 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.609358 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.610547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:28.611106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:33.150168 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:33.151220 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:33.184668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:33.184951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.185484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:33.185484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.185484 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:33.185484 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.185484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.185484 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:33.185484 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.185484 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.186492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.187027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:33.349075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:33.350798 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:33.351113 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:33.351303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.352831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:33.352831 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.352831 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:33.352831 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.352831 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.352831 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:33.352831 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.352831 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:33.354676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.355941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:33.403505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:33.404231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:33.405106 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:33.405591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.406386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:24:33.406386 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.406386 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:33.406386 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.406386 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.406386 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:33.406386 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.406386 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:33.407328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:33.408218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.408892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.409458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:33.409458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.409458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:33.439311 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:33.439994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:33.440949 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:33.441293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.442348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:24:33.442348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.442348 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:33.442348 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.442348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.442348 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:33.442348 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.442348 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:33.443375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.444200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:33.444706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.445646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:33.446625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.446625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:33.606788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:33.607501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:33.608107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:33.608371 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:33.608503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.609151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:33.609151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.609151 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:33.609151 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.609151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.609151 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:33.609151 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.609151 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.610130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:33.610753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:37.987322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:38.029756 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:389}}
Mar 19 18:24:38.029869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=103900) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:370}}
Mar 19 18:24:38.029991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:24:38.067589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, resource={'id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'name': 'private', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb', 'bee598c2-f62b-4321-b08d-23e3a7c6ccb9'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:09:27Z', 'updated_at': '2026-03-19T18:09:31Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 29513}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.068007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.068917 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b55270e8-5359-4f54-8804-fcbd7769eee3, external_ids_update=None, columns={'tag': 29513}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.068917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.069338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:38.069338 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.069338 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.069338 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.069338 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.069338 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.069338 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.069338 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.070390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.070681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.071003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:24:38.071003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.071003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:24:38.071003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:24:38.106200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, resource={'id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'name': 'public', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['7888df47-ce34-4091-9e08-c1c5949f53a2', 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-03-19T18:09:34Z', 'updated_at': '2026-03-19T18:09:44Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.106660 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.107200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-20b6196a-9254-4b37-a645-8253845242a7, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.107517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.108499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:38.108499 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.108499 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.108499 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.108499 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.108499 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.108499 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.108499 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.110842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.111339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:24:38.111339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.111339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:24:38.111339 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:24:38.141358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-420e2995-aa57-46db-9651-85807f50bcb9, resource={'id': '420e2995-aa57-46db-9651-85807f50bcb9', 'name': 'admin_net', 'tenant_id': '1ed140779dbc462d89fd3e785886b2bb', 'project_id': '1ed140779dbc462d89fd3e785886b2bb', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['388b450f-f17e-4671-94e9-9f169d754be7'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:13:33Z', 'updated_at': '2026-03-19T18:13:34Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 28229}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.141588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-420e2995-aa57-46db-9651-85807f50bcb9, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.141838 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-07b4049d-60f0-4621-a8e7-5dcac93308be, external_ids_update=None, columns={'tag': 28229}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.142066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.142549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:38.142549 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.142549 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.142549 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.142549 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.142549 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.142549 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.142549 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.144065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.144969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.145367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:24:38.145367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.145367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:24:38.145367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:24:38.152332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:38.157477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:38.199376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, resource={'id': '4d64a793-ee68-4a18-b938-f55304c6fcf6', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0bc68cc0-48dc-4abe-bbac-0a4f654efb2e'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:14:20Z', 'updated_at': '2026-03-19T18:14:21Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 59295}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.199727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.199867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-42ff4b0a-bf0a-4937-bf0f-c8b42f68f267, external_ids_update=None, columns={'tag': 59295}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.199984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.200570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:38.200570 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.200570 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.200570 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.200570 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.200570 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.200570 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.200570 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.201611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.201944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.202232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:24:38.202232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.202232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:24:38.202232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:24:38.241569 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.241835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.243104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:38.243104 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.243104 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.243104 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.243104 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.243104 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.243104 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.243104 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.243684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.244433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:38.311813 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, resource={'id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'enable_snat': True}, 'gw_port_id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-1id6n', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'ip_address': '172.24.5.52', 'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, {'ip_address': '2001:db8::2c3', 'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:25Z', 'revision_number': 3, 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89'}, resource_type=routers, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.312091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.314082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.314255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.314382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Unable to update router cf5e0251-94c8-4bce-b873-648b8cc72809. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:24:38.317248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.317641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:24:38.317897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.318153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.318153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:24:38.318153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.318153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:24:38.318153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:24:38.349895 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:38.352139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.352947 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.353354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.356643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:38.356643 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.356643 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.356643 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.356643 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.356643 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.356643 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.356643 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.362684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.364989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:38.405093 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:38.406081 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:38.409401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.410108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.414711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:24:38.414711 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.414711 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.414711 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.414711 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.414711 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.414711 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.414711 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:38.419950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.420452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:38.427122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.428838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.429374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:38.429374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.429374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:38.440282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:38.442556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:38.443692 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.447571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.450551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Traceback (most recent call last):
Mar 19 18:24:38.450551 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.450551 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.450551 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.450551 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.450551 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.450551 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.450551 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:38.452554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e511f4ff-22ad-447d-9b0b-c9ba60dc2596 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:38.452846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.453156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.453502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:38.473212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, resource={'id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'name': '', 'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'project_id': '', 'mac_address': 'fa:16:3e:11:31:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000160124', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:24Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.473517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::2c3/64', '172.24.5.52/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.473842 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=f319bf7e-5d34-47af-b620-bec8597c3819, lrouter_port=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.474120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.474966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:24:38.474966 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.474966 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.474966 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.474966 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.474966 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.474966 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.474966 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.475963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.476465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.476881 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:24:38.476881 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.476881 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:24:38.476881 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Synchronization completed (took 0.45 seconds)
Mar 19 18:24:38.611377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:38.612012 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:38.612902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.613357 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:38.613516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.614650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:38.614650 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.614650 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:38.614650 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.614650 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.614650 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:38.614650 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.614650 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.616145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:38.616741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:43.155219 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:43.156652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:43.158490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=433 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:24:43.205101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:43.205286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.206115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:43.206115 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.206115 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:43.206115 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.206115 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.206115 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:43.206115 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.206115 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.207543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.208130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:43.351720 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:43.352986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:43.353278 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:43.353479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.355264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:43.355264 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.355264 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:43.355264 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.355264 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.355264 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:43.355264 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.355264 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.356956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.357620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:43.405970 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:43.406379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:43.406820 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:43.407144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.407692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:24:43.407692 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.407692 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:43.407692 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.407692 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.407692 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:43.407692 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.407692 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:43.408536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:43.410661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.411829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.412285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:43.443017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:43.443531 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:43.444187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:43.444604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.445411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:43.445411 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.445411 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:43.445411 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.445411 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.445411 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:43.445411 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.445411 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:43.446467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:43.446893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:43.446893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.446893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:43.446893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.446893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.446893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:43.446893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.446893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:43.448015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.448418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:43.448845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.448845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:43.612187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:43.612975 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:43.613603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:43.614140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:43.614415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.615370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:43.615370 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.615370 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:43.615370 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.615370 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.615370 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:43.615370 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.615370 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.616378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:43.616987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:48.156036 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:48.157486 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:48.199696 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:48.200427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.201442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:48.201442 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.201442 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:48.201442 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.201442 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.201442 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:48.201442 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.201442 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.202963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.204429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:48.352301 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:48.353730 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:48.354202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:48.354579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.357672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:48.357672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.357672 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:48.357672 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.357672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.357672 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:48.357672 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.357672 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.360018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.360567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:48.406671 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:48.407166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:48.407599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:48.407812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.408325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:24:48.408325 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.408325 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:48.408325 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.408325 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.408325 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:48.408325 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.408325 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:48.409051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.409406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:48.409858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.410336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.410819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:48.410819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.410819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:48.443748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:48.444868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:48.445657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:48.446008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.446775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:24:48.446775 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.446775 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:48.446775 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.446775 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.446775 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:48.446775 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.446775 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:48.448138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.449014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:48.449971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.450679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:48.451500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.451500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:48.612946 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:48.613773 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:48.614581 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:48.615023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:48.615228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.616024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:48.616024 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.616024 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:48.616024 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.616024 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.616024 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:48.616024 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.616024 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.618376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:48.619216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:53.181700 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:53.183296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:53.233242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:53.233461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.234210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:53.234210 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.234210 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:53.234210 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.234210 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.234210 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:53.234210 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.234210 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.235108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.236092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:53.353302 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:53.354870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:53.355273 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:53.386001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:53.386635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:53.387177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.387177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:53.387177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.387177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.387177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:53.387177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.387177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:53.407243 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:53.408087 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:53.408768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:53.409403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.410408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:24:53.410408 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.410408 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:53.410408 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.410408 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.410408 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:53.410408 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.410408 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:53.411464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.412228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:53.413325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.414153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.414962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:53.414962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.414962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:53.444528 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:53.445115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:53.445739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:53.446019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.446854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:53.446854 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.446854 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:53.446854 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.446854 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.446854 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:53.446854 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.446854 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:53.447824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:53.448587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:53.448587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.448587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:53.448587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.448587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.448587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:53.448587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.448587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:53.448923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.449730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:53.450389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.450389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:53.613727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:53.614698 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:53.615234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:53.615608 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:53.615851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.616711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:53.616711 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.616711 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:53.616711 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.616711 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.616711 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:53.616711 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.616711 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.618500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:53.619323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:58.206429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:58.208257 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:58.249124 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:58.249124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.249760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:24:58.249760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.249760 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:58.249760 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.249760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.249760 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:58.249760 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.249760 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.250767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.251620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:58.354187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:58.356000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:58.356382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:58.356626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.357768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:58.357768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.357768 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:58.357768 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.357768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.357768 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:58.357768 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.357768 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.358935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.367458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:58.408183 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:58.409214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:24:58.409495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:58.410008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.410794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:58.410794 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.410794 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:58.410794 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.410794 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.410794 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:58.410794 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.410794 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:58.411695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.412657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:58.413517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.414202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:58.445579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:58.445752 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:58.446195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:58.446537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.447143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:58.447143 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.447143 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:58.447143 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.447143 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.447143 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:58.447143 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.447143 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:24:58.447939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:58.448760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:24:58.448760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.448760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:24:58.448760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.448760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.448760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:24:58.448760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.448760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:24:58.449263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.449768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:58.450331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.450331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:24:58.614561 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:24:58.615435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:24:58.616329 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:58.616815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:24:58.617135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.619855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:24:58.619855 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.619855 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:24:58.619855 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.619855 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.619855 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:24:58.619855 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.619855 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.620476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:24:58.621359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:03.206926 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:03.208462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.312078 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.312599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.313202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:03.355464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:03.357199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:03.357529 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:03.357756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.361141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:03.361141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.361141 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:03.361141 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.361141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.361141 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:03.361141 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.361141 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.362492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.363300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:03.408961 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:03.409672 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:03.412821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:03.413104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.413823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:03.413823 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.413823 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:03.413823 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.413823 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.413823 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:03.413823 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.413823 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:03.415003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:03.415923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:03.415923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.415923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:03.415923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.415923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.415923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:03.415923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.415923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:03.416293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.417169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.418158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:03.418158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.418158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:03.447035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:03.447035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:03.447530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:03.447833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:03.448472 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.448472 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:03.448472 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.448472 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.448472 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:03.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.448472 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:03.449258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:03.449626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:03.449626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.449626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:03.449626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.449626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.449626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:03.449626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.449626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:03.450016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.450403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:03.450805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.450805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:03.615290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:03.616045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:03.616841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:03.617864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:03.617864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.618232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:03.618232 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.618232 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:03.618232 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.618232 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.618232 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:03.618232 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.618232 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.619464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:03.620639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:08.207631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:08.209387 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:08.256933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:08.257278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.258392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:08.258392 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.258392 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:08.258392 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.258392 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.258392 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:08.258392 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.258392 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.259447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.259914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:08.356619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:08.359643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:08.359643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:08.359643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.360267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:08.360267 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.360267 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:08.360267 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.360267 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.360267 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:08.360267 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.360267 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.365074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.365654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:08.409795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:08.410844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:08.412619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:08.412619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.412751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:08.412751 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.412751 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:08.412751 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.412751 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.412751 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:08.412751 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.412751 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:08.413847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.415355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:08.415939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.416517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:08.447114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:08.447844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:08.449772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:08.449772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.450030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:08.450030 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.450030 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:08.450030 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.450030 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.450030 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:08.450030 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.450030 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:08.451535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:08.452639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:08.452639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.452639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:08.452639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.452639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.452639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:08.452639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.452639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:08.453910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.455086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:08.455933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.455933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:08.616348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:08.616908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:08.617551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:08.619084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:08.619084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.619227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:08.619227 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.619227 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:08.619227 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.619227 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.619227 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:08.619227 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.619227 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.620333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:08.620945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:13.208416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:13.209715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:13.246166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:13.246923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.247238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:13.247238 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.247238 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:13.247238 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.247238 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.247238 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:13.247238 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.247238 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.248571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.249046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:13.367932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:13.368960 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:13.369358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:13.369630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.370812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:13.370812 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.370812 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:13.370812 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.370812 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.370812 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:13.370812 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.370812 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.373087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.374210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:13.411171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:13.411418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:13.412326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:13.412756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.414324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:25:13.414324 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.414324 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:13.414324 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.414324 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.414324 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:13.414324 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.414324 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:13.416302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.417053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:13.418028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.419039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.419678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:13.419678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.419678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:13.448291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:13.448817 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:13.449706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:13.450146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.451036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:13.451036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.451036 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:13.451036 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.451036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.451036 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:13.451036 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.451036 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:13.452202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.453115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:13.453786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.454299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:13.454917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.454917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:13.617088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:13.617722 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:13.618463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:13.619448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:13.619448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.620052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:13.620052 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.620052 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:13.620052 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.620052 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.620052 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:13.620052 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.620052 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.622040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:13.622912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:18.208908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:18.210447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:18.242569 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:18.243060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:18.297670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:18.299391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.300315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:18.300315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.300315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.300315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:18.300315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.300315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:18.368130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:18.369848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:18.443577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:18.444827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:18.502227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:18.502814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.503440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:18.503934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.504441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:18.505105 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:18.505515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.506114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:18.506612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.507394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:18.617994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:18.618609 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:18.619070 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:18.619355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:18.619594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.620202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:18.620202 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.620202 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:18.620202 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.620202 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.620202 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:18.620202 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.620202 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.621249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:18.621924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:23.209683 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:23.211969 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:23.247262 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:23.247522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.248399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:23.248399 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.248399 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:23.248399 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.248399 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.248399 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:23.248399 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.248399 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.249392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.249774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:23.368926 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:23.370178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:23.370516 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:23.370715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.371374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:23.371374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.371374 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:23.371374 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.371374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.371374 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:23.371374 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.371374 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.372670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.373269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:23.422281 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:23.423046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:23.423797 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:23.424174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.425352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:23.425352 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.425352 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:23.425352 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.425352 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.425352 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:23.425352 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.425352 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:23.426651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:23.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:23.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:23.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:23.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.427145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:23.428227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.428750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.429291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:23.429291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.429291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:23.450469 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:23.451097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:23.451700 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:23.452059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.452919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:23.452919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.452919 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:23.452919 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.452919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.452919 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:23.452919 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.452919 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:23.453825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.454341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:23.454898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.455362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:23.455907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.455907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:23.618811 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:23.619522 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:23.619991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:23.620429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:23.620755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.621577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:23.621577 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.621577 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:23.621577 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.621577 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.621577 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:23.621577 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.621577 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.622640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:23.623290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:28.210431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:28.211912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:28.257061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:28.257335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.258113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:28.258113 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.258113 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:28.258113 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.258113 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.258113 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:28.258113 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.258113 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.259563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.260548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:28.369639 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:28.370912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:28.371269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:28.371630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.372623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:28.372623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.372623 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:28.372623 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.372623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.372623 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:28.372623 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.372623 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.373613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.374448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:28.423107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:28.423596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:28.423977 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:28.424287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.424927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:25:28.424927 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.424927 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:28.424927 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.424927 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.424927 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:28.424927 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.424927 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:28.425528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:28.426619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.427507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.428664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:28.452028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:28.452028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:28.452834 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:28.453326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.454535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:28.454535 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.454535 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:28.454535 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.454535 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.454535 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:28.454535 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.454535 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:28.456112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.456549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:28.457859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.458796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:28.459294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.459294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:28.619510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:28.620411 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:28.621287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:28.621786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:28.622086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.623036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:28.623036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.623036 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:28.623036 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.623036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.623036 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:28.623036 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.623036 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.625010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:28.625526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:33.211100 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:33.213840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:33.253116 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:33.253299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:33.255694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:33.256384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.257157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:33.257157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.257157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.257157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:33.257157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.257157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:33.370458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:33.371916 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:33.372370 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:33.372633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.373666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:33.373666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.373666 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:33.373666 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.373666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.373666 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:33.373666 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.373666 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.374646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.375231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:33.423928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:33.424382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:33.425047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:33.425348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.426091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:25:33.426091 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.426091 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:33.426091 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.426091 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.426091 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:33.426091 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.426091 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:33.426960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.427688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:33.428011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.428494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.429032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:33.429032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.429032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:33.451906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:33.454068 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:33.454373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:33.455031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.456290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:33.456290 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.456290 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:33.456290 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.456290 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.456290 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:33.456290 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.456290 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:33.457077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.457545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:33.458098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.458726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:33.459383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.459383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:33.620609 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:33.621269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:33.622149 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:33.622533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:33.622836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.623787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:33.623787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.623787 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:33.623787 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.623787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.623787 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:33.623787 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.623787 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.624767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:33.625135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:38.212650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:38.213918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:38.249652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:38.249900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.250733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:38.250733 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.250733 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:38.250733 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.250733 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.250733 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:38.250733 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.250733 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.251771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.252646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:38.371297 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:38.372765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:38.373112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:38.373169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.373746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:38.373746 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.373746 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:38.373746 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.373746 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.373746 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:38.373746 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.373746 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.374892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.375589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:38.424431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:38.425143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:38.425648 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:38.425900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.427058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:25:38.427058 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.427058 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:38.427058 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.427058 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.427058 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:38.427058 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.427058 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:38.427997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.428559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:38.429548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.430516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.431451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:38.431451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.431451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:38.453059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:38.454059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:38.454722 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:38.507609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.508274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:38.508692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.509812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:38.510374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.510374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:38.621335 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:38.622029 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:38.622769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:38.623126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:38.623313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.624043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:38.624043 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.624043 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:38.624043 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.624043 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.624043 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:38.624043 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.624043 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.625337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:38.626118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:43.212862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:43.214368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:43.217557 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:25:43.269023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:43.269313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.270131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:43.270131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.270131 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:43.270131 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.270131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.270131 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:43.270131 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.270131 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.271888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.272388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:43.372074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:43.374137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:43.374443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:43.374653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.375533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:43.375533 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.375533 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:43.375533 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.375533 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.375533 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:43.375533 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.375533 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.376654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.377550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:43.425207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:43.425714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:43.426736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:43.427995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.428269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:25:43.428269 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.428269 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:43.428269 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.428269 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.428269 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:43.428269 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.428269 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:43.429742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:43.430375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.431146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.431866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:43.453804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:43.454237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:43.454787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:43.455079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.456036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:43.456036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.456036 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:43.456036 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.456036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.456036 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:43.456036 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.456036 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:43.456973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.457412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:43.458560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.459139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:43.459899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.459899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:43.622088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:43.622582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:43.622934 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:43.623213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:43.623540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.624080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:43.624080 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.624080 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:43.624080 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.624080 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.624080 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:43.624080 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.624080 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.626336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:43.627067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:48.213739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:48.215290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:48.260719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:48.261157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.262376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:48.262376 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.262376 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:48.262376 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.262376 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.262376 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:48.262376 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.262376 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.263923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.264988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:48.372814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:48.373965 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:48.374168 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:48.374327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.375310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:48.375310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.375310 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:48.375310 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.375310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.375310 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:48.375310 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.375310 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.377650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.378387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:48.426021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:48.426594 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:48.427228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:48.427695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.428475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:25:48.428475 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.428475 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:48.428475 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.428475 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.428475 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:48.428475 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.428475 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:48.429784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.430529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:48.430940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.432121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.433031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:48.433031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.433031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:48.454900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:48.455629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:48.456525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:48.457179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.457599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:48.457599 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.457599 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:48.457599 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.457599 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.457599 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:48.457599 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.457599 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:48.458956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.459441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:48.460437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.460924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:48.461459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.461459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:48.622775 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:48.625130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:48.625130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:48.625130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:48.625130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.625977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:48.625977 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.625977 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:48.625977 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.625977 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.625977 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:48.625977 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.625977 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.627707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:48.628260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:53.214466 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:53.215715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:53.256988 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:53.257205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.258302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:53.258302 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.258302 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:53.258302 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.258302 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.258302 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:53.258302 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.258302 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.259640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.260849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:53.373669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:53.375098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:53.375342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:53.376066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.376278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:53.376278 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.376278 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:53.376278 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.376278 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.376278 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:53.376278 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.376278 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.377957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.379457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:53.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:53.427393 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:53.428331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:53.428754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.429991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:25:53.429991 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.429991 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:53.429991 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.429991 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.429991 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:53.429991 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.429991 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:53.431445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.431914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:53.433502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.436385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.437046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:53.437046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.437046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:53.455558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:53.456244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:53.456788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:53.457119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.457756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:53.457756 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.457756 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:53.457756 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.457756 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.457756 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:53.457756 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.457756 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:53.458615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.459321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:53.459790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.460601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:53.461549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.461549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:53.626831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:53.627400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:53.628151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:53.628817 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:53.628983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.629858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:53.629858 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.629858 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:53.629858 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.629858 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.629858 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:53.629858 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.629858 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.632187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:53.632570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:58.215129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:58.216429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:58.251014 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:58.251224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.252047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:25:58.252047 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.252047 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:58.252047 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.252047 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.252047 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:58.252047 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.252047 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.253416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.254185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:58.374564 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:58.375766 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:58.376202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:58.376419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.377511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:58.377511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.377511 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:58.377511 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.377511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.377511 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:58.377511 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.377511 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.378520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.379015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:58.427307 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:58.427626 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:25:58.428282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:58.428652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.429920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:25:58.429920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.429920 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:58.429920 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.429920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.429920 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:58.429920 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.429920 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:58.430931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.431263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:25:58.432059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.432442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.432797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:58.432797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.432797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:58.456140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:58.456902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:58.457544 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:58.457927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.458984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:25:58.458984 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.458984 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:58.458984 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.458984 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.458984 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:58.458984 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.458984 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:25:58.460455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.460785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:25:58.462333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:58.463034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.463034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:25:58.627378 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:25:58.627989 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:25:58.629063 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:58.629606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:25:58.629833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.661262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:25:58.661262 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.661262 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:25:58.661262 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.661262 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.661262 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:25:58.661262 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.661262 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.663131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:25:58.664108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:03.215726 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:03.217520 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:03.264367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.266749 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.267712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.268272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:03.375265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:03.376776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:03.377101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:03.377276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.378153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:03.378153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.378153 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:03.378153 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.378153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.378153 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:03.378153 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.378153 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.379450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.380004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.434555 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:03.436160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:03.436844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.437270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:03.456757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:03.457632 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:03.458272 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:03.458900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.459957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:03.459957 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.459957 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:03.459957 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.459957 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.459957 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:03.459957 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.459957 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:03.461539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.462359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:03.463405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.464513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:03.465073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.465073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:03.630525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:03.631396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:03.632575 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:03.633072 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:03.633349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.634479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:03.634479 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.634479 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:03.634479 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.634479 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.634479 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:03.634479 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.634479 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.635989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:03.636753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:08.216596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:08.218069 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:08.253157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:08.253335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.254031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:08.254031 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.254031 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:08.254031 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.254031 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.254031 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:08.254031 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.254031 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.255293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.255961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:08.376105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:08.377349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:08.377606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:08.377768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.378526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:08.378526 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.378526 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:08.378526 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.378526 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.378526 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:08.378526 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.378526 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.379488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.380016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:08.428790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:08.429462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:08.430503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:08.430747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.432649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:08.432649 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.432649 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:08.432649 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.432649 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.432649 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:08.432649 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.432649 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:08.433227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.433687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:08.434399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.434848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.435387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:08.435387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.435387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:08.457603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:08.458031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:08.458519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:08.458838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.459386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:08.459386 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.459386 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:08.459386 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.459386 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.459386 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:08.459386 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.459386 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:08.460200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.460916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:08.462243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.463253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:08.463945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.463945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:08.631380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:08.631737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:08.632125 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:08.632337 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:08.632468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.632978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:08.632978 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.632978 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:08.632978 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.632978 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.632978 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:08.632978 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.632978 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.634070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:08.634534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:13.217534 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:13.218813 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:13.250633 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:13.251007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:13.306523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:13.308188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.309271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:13.309271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.309271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.309271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:13.309271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.309271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:13.377036 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:13.378485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:13.379034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:13.379260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.380313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:13.380313 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.380313 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:13.380313 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.380313 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.380313 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:13.380313 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.380313 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.418234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.419216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:13.429558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:13.430203 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:13.431198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:13.431603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.432488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:13.432488 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.432488 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:13.432488 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.432488 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.432488 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:13.432488 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.432488 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:13.434013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.434556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:13.435886 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.436367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.436937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:13.436937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.436937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:13.458321 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:13.458769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:13.459407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:13.459724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.460488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:13.460488 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.460488 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:13.460488 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.460488 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.460488 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:13.460488 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.460488 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:13.461645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.462657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:13.463251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.464373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:13.465669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.465669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:13.631983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:13.632791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:13.633321 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:13.633774 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:13.633866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.634538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:13.634538 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.634538 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:13.634538 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.634538 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.634538 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:13.634538 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.634538 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.635652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:13.636702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:18.218907 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:18.219796 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:18.252844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:18.253170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.254528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:18.254528 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.254528 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:18.254528 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.254528 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.254528 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:18.254528 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.254528 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.255578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.256347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:18.377754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:18.379134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:18.379459 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:18.379675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.380433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:18.380433 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.380433 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:18.380433 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.380433 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.380433 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:18.380433 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.380433 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.381781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.382407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:18.430400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:18.430937 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:18.431781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:18.432116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.433166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:18.433166 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.433166 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:18.433166 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.433166 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.433166 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:18.433166 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.433166 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:18.434191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.434592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:18.435206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.435587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.436002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:18.436002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.436002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:18.510197 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:18.514408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:18.514753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:18.515132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.515839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:18.515839 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.515839 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:18.515839 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.515839 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.515839 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:18.515839 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.515839 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:18.516845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:18.517312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:18.517312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.517312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:18.517312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.517312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.517312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:18.517312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.517312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:18.518229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.518724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:18.520381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.520381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:18.632727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:18.633423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:18.634485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:18.635390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:18.636048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.637223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:18.637223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.637223 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:18.637223 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.637223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.637223 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:18.637223 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.637223 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.638555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:18.639077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:23.218994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:23.221167 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:23.258330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:23.258594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.259476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:23.259476 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.259476 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:23.259476 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.259476 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.259476 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:23.259476 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.259476 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.260936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.261713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:23.378513 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:23.379458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:23.379674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:23.379837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.380530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:23.380530 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.380530 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:23.380530 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.380530 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.380530 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:23.380530 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.380530 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.381322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.381854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:23.431582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:23.432443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:23.433057 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:23.433356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.434809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:23.434809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.434809 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:23.434809 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.434809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.434809 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:23.434809 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.434809 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:23.435903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.436828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:23.437396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.438202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.439202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:23.439202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.439202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:23.513741 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:23.514345 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:23.515407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:23.515778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.516597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:23.516597 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.516597 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:23.516597 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.516597 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.516597 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:23.516597 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.516597 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:23.518919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:23.519402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:23.519402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.519402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:23.519402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.519402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.519402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:23.519402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.519402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:23.519743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.520337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:23.520917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.520917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:23.633386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:23.634786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:23.634786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:23.634997 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:23.635109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.636333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:23.636333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.636333 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:23.636333 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.636333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.636333 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:23.636333 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.636333 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.637872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:23.638664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:28.220521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:28.223419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:28.275438 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:28.275800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.276660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:28.276660 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.276660 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:28.276660 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.276660 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.276660 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:28.276660 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.276660 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.277829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.278473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:28.379218 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:28.380831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:28.381348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:28.381596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.382720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:28.382720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.382720 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:28.382720 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.382720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.382720 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:28.382720 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.382720 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.384562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.385191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:28.432478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:28.433230 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:28.434071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:28.434342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.435401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:28.435401 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.435401 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:28.435401 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.435401 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.435401 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:28.435401 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.435401 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:28.438342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:28.439149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.439835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.441387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:28.514563 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:28.515113 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:28.516095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:28.516574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.517301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:28.517301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.517301 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:28.517301 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.517301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.517301 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:28.517301 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.517301 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:28.518131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.519047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:28.519861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.520809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:28.634380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:28.635274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:28.636201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:28.636700 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:28.636997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.637996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:28.637996 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.637996 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:28.637996 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.637996 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.637996 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:28.637996 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.637996 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.639954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:28.641062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:33.220652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:33.222369 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:33.261424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:33.261715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.262869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:33.262869 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.262869 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:33.262869 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.262869 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.262869 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:33.262869 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.262869 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.263936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.264493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:33.380154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:33.383593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:33.384152 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:33.384510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.385689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:33.385689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.385689 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:33.385689 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.385689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.385689 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:33.385689 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.385689 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.387061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.387917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:33.433238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:33.433784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:33.434779 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:33.435232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.436137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:33.436137 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.436137 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:33.436137 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.436137 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.436137 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:33.436137 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.436137 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:33.437150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.437660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:33.438203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.439335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.440190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:33.440190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.440190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:33.515336 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:33.515680 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:33.516556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:33.516985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.517867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:33.517867 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.517867 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:33.517867 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.517867 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.517867 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:33.517867 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.517867 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:33.519340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.520088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:33.521027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.521791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:33.522598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.522598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:33.635276 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:33.636821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:33.637757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:33.638264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:33.638557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.639473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:33.639473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.639473 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:33.639473 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.639473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.639473 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:33.639473 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.639473 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.640910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:33.641279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:38.222980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:38.224545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:38.257081 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:38.257459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.258554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:38.258554 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.258554 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:38.258554 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.258554 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.258554 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:38.258554 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.258554 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.260733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.261712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:38.382785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:38.384537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:38.384847 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:38.385042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.386645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:38.386645 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.386645 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:38.386645 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.386645 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.386645 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:38.386645 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.386645 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.388156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.388514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:38.433856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:38.434900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:38.435464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:38.435723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.436387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:38.436387 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.436387 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:38.436387 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.436387 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.436387 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:38.436387 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.436387 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:38.437231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.437689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:38.438019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.438526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.439080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:38.439080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.439080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:38.516013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:38.516605 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:38.517991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:38.518804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.519535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:38.519535 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.519535 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:38.519535 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.519535 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.519535 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:38.519535 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.519535 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:38.520419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:38.521482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:38.522106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.522593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:38.636916 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:38.637148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:38.637463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:38.637811 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:38.637961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.638421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:38.638421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.638421 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:38.638421 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.638421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.638421 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:38.638421 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.638421 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.639164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:38.639742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:43.223686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:43.225212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:43.227808 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:26:43.263617 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:43.263990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.265017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:43.265017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.265017 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:43.265017 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.265017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.265017 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:43.265017 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.265017 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.266427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.267117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:43.383532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:43.385075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:43.385487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:43.385746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.386787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:43.386787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.386787 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:43.386787 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.386787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.386787 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:43.386787 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.386787 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.388081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.388980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:43.434917 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:43.435475 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:43.436030 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:43.436323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.437107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:43.437107 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.437107 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:43.437107 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.437107 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.437107 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:43.437107 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.437107 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:43.437700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:43.438621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.439447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.440460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:43.516870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:43.517410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:43.518217 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:43.518592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.519293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:43.519293 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.519293 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:43.519293 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.519293 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.519293 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:43.519293 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.519293 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:43.520323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.520781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:43.521531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.521987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:43.522453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.522453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:43.637654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:43.638312 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:43.639141 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:43.639444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:43.639626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.640435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:43.640435 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.640435 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:43.640435 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.640435 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.640435 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:43.640435 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.640435 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.642472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:43.643450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:48.224395 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:48.225869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:48.260107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:48.260389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.261361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:48.261361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.261361 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:48.261361 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.261361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.261361 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:48.261361 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.261361 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.262834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.263641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:48.384256 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:48.385581 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:48.385870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:48.386066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.386905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:48.386905 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.386905 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:48.386905 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.386905 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.386905 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:48.386905 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.386905 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.387911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.388633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:48.437504 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:48.437504 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:48.437504 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:48.437504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.439173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.439827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:48.440220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.440646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.441084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:48.441084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.441084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:48.517503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:48.517962 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:48.519150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:48.519685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.520768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:48.520768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.520768 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:48.520768 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.520768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.520768 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:48.520768 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.520768 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:48.522036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.522665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:48.523421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.524446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:48.525343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.525343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:48.638302 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:48.638868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:48.640161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:48.640803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:48.641219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.642072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:48.642072 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.642072 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:48.642072 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.642072 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.642072 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:48.642072 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.642072 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.643061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:48.643568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:53.225033 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:53.228282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:53.266327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:53.266722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.267472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:53.267472 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.267472 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:53.267472 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.267472 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.267472 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:53.267472 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.267472 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.268690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.270028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:53.385046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:53.386682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:53.387163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:53.387346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.388370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:53.388370 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.388370 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:53.388370 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.388370 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.388370 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:53.388370 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.388370 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.389698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.390662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:53.436213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:53.437042 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:53.437583 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:53.438056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.439007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:53.439007 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.439007 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:53.439007 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.439007 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.439007 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:53.439007 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.439007 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:53.440062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.440788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:53.441342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.442083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.442924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:53.442924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.442924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:53.518311 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:53.519044 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:53.519710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:53.519995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.520632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:53.520632 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.520632 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:53.520632 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.520632 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.520632 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:53.520632 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.520632 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:53.521667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.522178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:53.522706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.523223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:53.523748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.523748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:53.639216 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:53.639839 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:53.640892 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:53.641422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:53.641759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.642710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:53.642710 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.642710 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:53.642710 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.642710 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.642710 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:53.642710 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.642710 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.643753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:53.644342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:58.226493 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:58.227792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:58.259716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:58.260241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.261348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:26:58.261348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.261348 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:58.261348 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.261348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.261348 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:58.261348 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.261348 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.262536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.263113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:58.385914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:58.387003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.388995 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.389529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.390053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:58.436835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:58.440427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:26:58.441082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:58.441082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.441588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:26:58.441588 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.441588 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:58.441588 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.441588 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.441588 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:58.441588 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.441588 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:58.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.442645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:26:58.442928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.443360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.443913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:58.443913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.443913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:58.519053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:58.519592 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:58.520410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:58.520661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.521427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:26:58.521427 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.521427 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:58.521427 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.521427 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.521427 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:58.521427 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.521427 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:26:58.522077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.522393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:26:58.522888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.523257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:58.523634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.523634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:26:58.640126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:26:58.640675 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:26:58.641587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:58.642170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:26:58.642420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.643433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:26:58.643433 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.643433 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:26:58.643433 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.643433 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.643433 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:26:58.643433 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.643433 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.645918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:26:58.646408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:03.227485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:03.229895 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:03.274620 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:03.274867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.275620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:03.275620 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.275620 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:03.275620 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.275620 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.275620 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:03.275620 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.275620 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.276870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.278254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:03.386474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:03.388074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:03.388445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:03.388684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.389727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:03.389727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.389727 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:03.389727 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.389727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.389727 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:03.389727 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.389727 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.391495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.392703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:03.440636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:03.441334 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:03.442022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:03.442342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.445097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:03.445097 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.445097 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:03.445097 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.445097 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.445097 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:03.445097 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.445097 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:03.446828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.447583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:03.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.449914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.450567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:03.450567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.450567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:03.519709 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:03.520754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:03.521368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:03.521604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.523941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.524314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:03.524602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.524915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:03.525256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.525256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:03.640989 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:03.641823 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:03.642285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:03.642521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:03.642649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.643214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:03.643214 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.643214 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:03.643214 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.643214 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.643214 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:03.643214 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.643214 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.644298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:03.644774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:08.229130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:08.230349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:08.264834 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:08.265320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.266732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:08.266732 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.266732 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:08.266732 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.266732 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.266732 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:08.266732 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.266732 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.268468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.269000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:08.387277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:08.388606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:08.388997 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:08.389269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.390236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:08.390236 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.390236 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:08.390236 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.390236 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.390236 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:08.390236 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.390236 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.391749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:08.441476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:08.442160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:08.443027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:08.443339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.444254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:08.444254 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.444254 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:08.444254 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.444254 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.444254 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:08.444254 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.444254 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:08.445764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.446295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:08.447493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.448066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.448581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:08.448581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.448581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:08.521124 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:08.522395 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:08.523079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:08.523484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.524412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:27:08.524412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.524412 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:08.524412 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.524412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.524412 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:08.524412 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.524412 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:08.525479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:08.527228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:08.528446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.529571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:08.641914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:08.642549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:08.643454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:08.643865 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:08.644137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.645385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:08.645385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.645385 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:08.645385 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.645385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.645385 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:08.645385 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.645385 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.647760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:08.648795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:13.229984 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:13.231427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:13.270917 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:13.271339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.272052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:13.272052 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.272052 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:13.272052 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.272052 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.272052 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:13.272052 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.272052 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.273033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.274289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:13.388163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:13.390136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:13.390454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:13.390629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.391560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:13.391560 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.391560 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:13.391560 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.391560 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.391560 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:13.391560 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.391560 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.392910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.393296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:13.442353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:13.442888 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:13.443739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:13.444092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.444910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:13.444910 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.444910 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:13.444910 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.444910 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.444910 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:13.444910 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.444910 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:13.446419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.446947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:13.450457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.450983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.451504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:13.451504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.451504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:13.522066 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:13.522736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:13.523599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:13.523910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.524801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:27:13.524801 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.524801 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:13.524801 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.524801 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.524801 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:13.524801 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.524801 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:13.527978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.528499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:13.529359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.530069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:13.530630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.530630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:13.642649 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:13.643430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:13.644697 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:13.645374 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:13.645693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.646902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:13.646902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.646902 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:13.646902 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.646902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.646902 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:13.646902 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.646902 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.647891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:13.648364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:18.230694 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:18.232351 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:18.279971 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:18.280278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.281130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:18.281130 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.281130 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:18.281130 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.281130 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.281130 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:18.281130 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.281130 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.282185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.283122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:18.389410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:18.390757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:18.391080 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:18.391248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:18.392189 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.392189 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:18.392189 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.392189 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.392189 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:18.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.392189 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.393698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.394233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:18.443049 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:18.443782 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:18.444541 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:18.444889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.445760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:18.445760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.445760 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:18.445760 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.445760 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.445760 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:18.445760 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.445760 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:18.446742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.447294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:18.447811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.448334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.449180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:18.449180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.449180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:18.522671 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:18.523022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:18.525007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:18.525007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.525939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:18.525939 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.525939 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:18.525939 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.525939 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.525939 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:18.525939 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.525939 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:18.526725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:18.527532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:18.527532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.527532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:18.527532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.527532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.527532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:18.527532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.527532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:18.527942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.528781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:18.530124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.530124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:18.643462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:18.644525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:18.645002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:18.645303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:18.645477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.646228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:18.646228 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.646228 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:18.646228 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.646228 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.646228 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:18.646228 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.646228 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.647978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:18.648473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:23.231444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:23.235317 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:23.269987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:23.270300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:23.272389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:23.272809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.273181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:23.273181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.273181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.273181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:23.273181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.273181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:23.390279 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:23.392207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:23.392504 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:23.392704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.393683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:23.393683 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.393683 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:23.393683 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.393683 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.393683 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:23.393683 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.393683 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.395856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.396487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:23.443778 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:23.444293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:23.445114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:23.445353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.446097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:23.446097 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.446097 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:23.446097 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.446097 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.446097 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:23.446097 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.446097 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:23.447554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.448210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:23.449269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.449965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.450806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:23.450806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.450806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:23.523678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:23.524822 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:23.525408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:23.525668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.526319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:23.526319 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.526319 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:23.526319 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.526319 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.526319 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:23.526319 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.526319 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:23.527719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:23.528551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:23.528551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.528551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:23.528551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.528551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.528551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:23.528551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.528551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:23.529479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.529953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:23.530494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.530494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:23.644295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:23.645083 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:23.645499 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:23.645737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:23.645901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.646603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:23.646603 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.646603 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:23.646603 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.646603 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.646603 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:23.646603 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.646603 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.648153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:23.649015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:28.233347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:28.235027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:28.274380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:28.274636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.275352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:28.275352 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.275352 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:28.275352 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.275352 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.275352 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:28.275352 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.275352 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.276578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.277582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:28.391261 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:28.392913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:28.393299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:28.393548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.394629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:28.394629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.394629 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:28.394629 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.394629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.394629 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:28.394629 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.394629 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.396411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:28.444626 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:28.445183 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:28.446000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:28.446337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.447046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:28.447046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.447046 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:28.447046 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.447046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.447046 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:28.447046 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.447046 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:28.447800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.448363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:28.448655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.449107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.449641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:28.449641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.449641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:28.524586 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:28.524871 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:28.525709 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:28.526556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.527418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:28.527418 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.527418 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:28.527418 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.527418 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.527418 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:28.527418 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.527418 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:28.528275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:28.528587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:28.528587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.528587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:28.528587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.528587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.528587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:28.528587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.528587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:28.529888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.530252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:28.530628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.530628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:28.645509 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:28.646454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:28.647623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:28.647623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:28.648035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.648841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:28.648841 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.648841 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:28.648841 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.648841 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.648841 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:28.648841 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.648841 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.650728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:28.651317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:33.234057 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:33.235464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:33.265705 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:33.265954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.266512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:33.266512 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.266512 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:33.266512 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.266512 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.266512 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:33.266512 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.266512 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.267354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.268371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:33.391947 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:33.393346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:33.393651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:33.393816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.394595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:33.394595 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.394595 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:33.394595 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.394595 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.394595 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:33.394595 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.394595 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.396369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.396988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:33.445259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:33.446545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:33.447768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:33.448240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.449348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:33.449348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.449348 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:33.449348 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.449348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.449348 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:33.449348 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.449348 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:33.451091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.451910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:33.452862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.453840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.454656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:33.454656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.454656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:33.525566 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:33.526047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:33.527521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:33.527897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.528568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:33.528568 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.528568 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:33.528568 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.528568 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.528568 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:33.528568 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.528568 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:33.529861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:33.530406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:33.530406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.530406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:33.530406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.530406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.530406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:33.530406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.530406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:33.530986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.531526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:33.532268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.532268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:33.646347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:33.646933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:33.647597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:33.648208 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:33.648457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.649375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:27:33.649375 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.649375 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:33.649375 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.649375 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.649375 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:33.649375 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.649375 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.650712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:33.651818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:38.235132 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:38.236545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:38.273820 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:38.274124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.275011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:38.275011 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.275011 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:38.275011 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.275011 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.275011 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:38.275011 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.275011 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.276015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.276727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:38.392611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:38.394056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:38.394425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:38.394510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.395268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:38.395268 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.395268 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:38.395268 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.395268 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.395268 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:38.395268 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.395268 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.397146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.397691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:38.446065 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:38.447229 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:38.448058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:38.448346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.451919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.452858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:38.454217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.455061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.456037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:38.456037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.456037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:38.526315 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:38.526571 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:38.527428 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:38.527745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.529012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:38.529012 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.529012 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:38.529012 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.529012 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.529012 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:38.529012 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.529012 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:38.529480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:38.529914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:38.529914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.529914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:38.529914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.529914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.529914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:38.529914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.529914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:38.530635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.530996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:38.531372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.531372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:38.647014 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:38.647749 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:38.650282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:38.650282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:38.650282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.650655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:27:38.650655 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.650655 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:38.650655 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.650655 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.650655 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:38.650655 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.650655 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.652692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:38.653592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:43.235689 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:43.237457 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:43.239471 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:27:43.275223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:43.276150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.277133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:43.277133 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.277133 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:43.277133 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.277133 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.277133 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:43.277133 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.277133 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.278142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.278715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:43.393426 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:43.394637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:43.394835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:43.395006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.395626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:43.395626 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.395626 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:43.395626 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.395626 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.395626 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:43.395626 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.395626 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.396798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.397415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:43.447164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:43.448146 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:43.449155 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:43.449568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.451038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:43.451038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.451038 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:43.451038 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.451038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.451038 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:43.451038 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.451038 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:43.452923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.453475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:43.455134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.455766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.456532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:43.456532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.456532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:43.526950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:43.529911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:43.529911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:43.530047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.530813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:43.530813 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.530813 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:43.530813 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.530813 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.530813 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:43.530813 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.530813 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:43.532187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:43.532658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:43.532658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.532658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:43.532658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.532658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.532658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:43.532658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.532658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:43.533748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.534285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:43.534836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.534836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:43.647869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:43.648652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:43.649280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:43.649474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:43.649614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.650304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:27:43.650304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.650304 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:43.650304 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.650304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.650304 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:43.650304 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.650304 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.651706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:43.652403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:48.236407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:48.238100 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:48.269090 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:48.270236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.270873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:48.270873 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.270873 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:48.270873 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.270873 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.270873 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:48.270873 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.270873 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.272198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.273121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:48.394211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:48.395647 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:48.395866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:48.396015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.396745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:48.396745 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.396745 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:48.396745 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.396745 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.396745 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:48.396745 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.396745 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.398628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.399201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:48.447929 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:48.448478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:48.449275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:48.449584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.450282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:48.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:48.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.450282 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:48.450282 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.450282 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:48.451045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:48.453046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.453967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.455136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:48.527730 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:48.528130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:48.528810 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:48.529285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.530102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:48.530102 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.530102 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:48.530102 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.530102 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.530102 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:48.530102 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.530102 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:48.531127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:48.531800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:48.531800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.531800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:48.531800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.531800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.531800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:48.531800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.531800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:48.532415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.534162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:48.535670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.535670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:48.648620 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:48.649389 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:48.650201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:48.650640 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:48.650908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.652079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:27:48.652079 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.652079 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:48.652079 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.652079 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.652079 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:48.652079 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.652079 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.655155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:48.655639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:53.237414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:53.239369 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:53.275396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:53.275551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.276345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:53.276345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.276345 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:53.276345 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.276345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.276345 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:53.276345 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.276345 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.277210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.278221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:53.395089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:53.396686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:53.397117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:53.397382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.398136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:53.398136 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.398136 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:53.398136 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.398136 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.398136 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:53.398136 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.398136 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.400102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.400925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:53.448586 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:53.449384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:53.450708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:53.451258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.452869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:53.452869 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.452869 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:53.452869 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.452869 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.452869 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:53.452869 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.452869 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:53.454380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.454932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:53.456149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.456627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.457278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:53.457278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.457278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:53.528486 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:53.529095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:53.530001 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:53.530404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.531567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:27:53.531567 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.531567 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:53.531567 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.531567 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.531567 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:53.531567 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.531567 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:53.533079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.533762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:53.534769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.535559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:53.536493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.536493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:53.649433 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:53.650688 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:53.651371 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:53.651647 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:53.651801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.652543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:27:53.652543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.652543 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:53.652543 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.652543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.652543 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:53.652543 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.652543 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.653955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:53.654334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:58.238277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:58.240022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:58.272248 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:58.272756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.274749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:27:58.274749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.274749 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:58.274749 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.274749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.274749 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:58.274749 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.274749 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.276450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.277018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:58.395735 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:58.397139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:58.397431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:58.397594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.398466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:27:58.398466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.398466 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:58.398466 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.398466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.398466 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:58.398466 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.398466 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.399805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.400958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:58.449396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:58.449722 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:27:58.450455 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:58.450622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.451321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:27:58.451321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.451321 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:58.451321 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.451321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.451321 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:58.451321 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.451321 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:58.452330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.452783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:27:58.453272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.453689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.454281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:58.454281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.454281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:58.529056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:58.529666 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:58.531087 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:58.531738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.532701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:27:58.532701 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.532701 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:58.532701 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.532701 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.532701 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:58.532701 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.532701 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:27:58.533692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.534351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:27:58.534788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.535342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:58.535809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.535809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:27:58.650439 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:27:58.652911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:27:58.652911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:58.652911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:27:58.652911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.653272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:27:58.653272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.653272 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:27:58.653272 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.653272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.653272 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:27:58.653272 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.653272 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.654629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:27:58.655044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:03.240391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:03.242090 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:03.283463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:03.283770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.284789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:03.284789 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.284789 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:03.284789 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.284789 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.284789 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:03.284789 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.284789 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.286359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.286985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:03.396514 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:03.397817 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:03.398143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:03.398226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.398962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:03.398962 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.398962 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:03.398962 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.398962 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.398962 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:03.398962 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.398962 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.400279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.400820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:03.450371 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:03.450781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:03.451669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:03.451964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.452828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:03.452828 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.452828 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:03.452828 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.452828 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.452828 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:03.452828 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.452828 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:03.454256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.454651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:03.456652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.457197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.457732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:03.457732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.457732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:03.529674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:03.530295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:03.531025 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:03.531283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.531934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:28:03.531934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.531934 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:03.531934 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.531934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.531934 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:03.531934 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.531934 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:03.532978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.533415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:03.534147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.534489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:03.534841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.534841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:03.651425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:03.652680 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:03.653405 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:03.654143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:03.654143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.655013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:03.655013 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.655013 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:03.655013 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.655013 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.655013 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:03.655013 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.655013 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.656354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:03.657015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:08.241130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:08.244928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:08.274167 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:08.274340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.275474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:08.275474 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.275474 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:08.275474 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.275474 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.275474 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:08.275474 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.275474 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.276449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.276917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:08.397204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:08.398593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:08.399059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:08.399321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.400421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:08.400421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.400421 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:08.400421 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.400421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.400421 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:08.400421 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.400421 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.401501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.402009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:08.451023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:08.453194 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:08.453863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:08.454146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.454817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:08.454817 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.454817 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:08.454817 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.454817 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.454817 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:08.454817 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.454817 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:08.455627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.456014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:08.456416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.457292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.458128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:08.458128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.458128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:08.530480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:08.531609 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:08.532318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:08.532607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.533293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:28:08.533293 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.533293 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:08.533293 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.533293 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.533293 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:08.533293 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.533293 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:08.534081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.534507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:08.534906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.535528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:08.535989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.535989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:08.652568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:08.654004 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:08.654971 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:08.655452 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:08.655747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:08.658360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:08.659023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:08.659645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:08.659645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:08.659645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:08.659645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:08.659645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:08.659645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:13.242974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:13.244269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:13.273694 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:13.274027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.274831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:13.274831 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.274831 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:13.274831 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.274831 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.274831 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:13.274831 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.274831 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.275793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.276271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:13.398148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:13.399979 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:13.399979 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:13.399979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.400779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:13.400779 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.400779 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:13.400779 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.400779 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.400779 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:13.400779 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.400779 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.402357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.402866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:13.453899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:13.453899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:13.454784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:13.455025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.455809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:13.455809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.455809 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:13.455809 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.455809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.455809 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:13.455809 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.455809 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:13.457730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.458301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:13.461053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.461511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.462047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:13.462047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.462047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:13.531555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:13.532263 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:13.532851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:13.533090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.533702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:28:13.533702 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.533702 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:13.533702 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.533702 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.533702 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:13.533702 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.533702 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:13.535438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:13.536845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:13.537617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.539595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:13.653612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:13.654279 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:13.655201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:13.655623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:13.655861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.656718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:13.656718 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.656718 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:13.656718 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.656718 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.656718 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:13.656718 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.656718 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.657822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:13.658417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:18.243682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:18.245511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:18.291851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:18.292240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.293310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:18.293310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.293310 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:18.293310 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.293310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.293310 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:18.293310 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.293310 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.294679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.296427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:18.398801 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:18.399943 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:18.400237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:18.400406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.401322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:18.401322 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.401322 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:18.401322 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.401322 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.401322 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:18.401322 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.401322 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.402409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.403179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:18.454145 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:18.454519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:18.455659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:18.456225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.457587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:18.457587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.457587 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:18.457587 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.457587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.457587 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:18.457587 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.457587 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:18.458331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:18.459134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.459826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.462234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:18.532309 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:18.532905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:18.533766 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:18.536142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.536811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:18.537283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.537746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:18.538249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.538249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:18.654386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:18.655179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:18.655902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:18.656274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:18.656486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.657292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:18.657292 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.657292 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:18.657292 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.657292 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.657292 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:18.657292 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.657292 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.661579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:18.663051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:23.244482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:23.246115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:23.285688 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:23.285862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.286646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:23.286646 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.286646 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:23.286646 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.286646 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.286646 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:23.286646 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.286646 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.288092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.288610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:23.399570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:23.401333 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:23.401947 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:23.402242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.403404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:23.403404 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.403404 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:23.403404 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.403404 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.403404 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:23.403404 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.403404 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.404678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.405079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:23.454779 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:23.455255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:23.456225 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:23.456710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.457688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:23.457688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.457688 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:23.457688 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.457688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.457688 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:23.457688 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.457688 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:23.459300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:23.459903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.460415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.460960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:23.532941 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:23.533717 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:23.534616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:23.534895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.535962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:28:23.535962 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.535962 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:23.535962 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.535962 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.535962 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:23.535962 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.535962 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:23.537424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.537867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:23.539212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.539689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:23.540216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.540216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:23.655131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:23.656474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:23.656980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:23.657422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:23.657700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:23.662964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:23.663658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:23.664545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:23.664545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:23.664545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:23.664545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:23.664545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:23.664545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:28.245437 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:28.247113 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:28.287547 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:28.287825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.288641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:28.288641 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.288641 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:28.288641 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.288641 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.288641 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:28.288641 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.288641 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.289855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.290714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:28.400490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:28.401827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:28.402035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:28.402278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.402872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:28.402872 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.402872 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:28.402872 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.402872 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.402872 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:28.402872 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.402872 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.404225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.405167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:28.455373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:28.455901 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:28.456612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:28.457083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.458038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:28.458038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.458038 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:28.458038 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.458038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.458038 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:28.458038 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.458038 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:28.459344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.459665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:28.460590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.461261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.462015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:28.462015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.462015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:28.533603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:28.534319 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:28.535213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:28.535696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.536679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:28.536679 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.536679 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:28.536679 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.536679 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.536679 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:28.536679 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.536679 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:28.537751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:28.538401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:28.538401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.538401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:28.538401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.538401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.538401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:28.538401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.538401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:28.538851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.539749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:28.540468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.540468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:28.656283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:28.656795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:28.657496 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:28.658190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:28.658190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.658632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:28.658632 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.658632 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:28.658632 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.658632 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.658632 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:28.658632 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.658632 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.659815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:28.661036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:33.248484 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:33.248484 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:33.301173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:33.301508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.302268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:33.302268 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.302268 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:33.302268 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.302268 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.302268 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:33.302268 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.302268 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.303298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.304055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:33.402086 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:33.403374 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:33.403482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:33.403632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.404383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:33.404383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.404383 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:33.404383 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.404383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.404383 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:33.404383 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.404383 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.405322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.405737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:33.455952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:33.456797 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:33.457646 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:33.457835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.458587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:33.458587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.458587 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:33.458587 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.458587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.458587 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:33.458587 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.458587 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:33.460411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.461264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:33.461941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.462402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.462915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:33.462915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.462915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:33.534621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:33.535445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:33.536527 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:33.536943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.537845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:33.537845 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.537845 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:33.537845 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.537845 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.537845 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:33.537845 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.537845 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:33.538929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:33.539360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:33.539360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.539360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:33.539360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.539360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.539360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:33.539360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.539360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:33.539990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.540509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:33.541163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.541163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:33.657205 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:33.658004 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:33.658655 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:33.659165 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:33.659443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.660462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:33.660462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.660462 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:33.660462 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.660462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.660462 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:33.660462 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.660462 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.661788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:33.662609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:38.246837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:38.248414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:38.284031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:38.284215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:38.286932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:38.287786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.288561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:38.288561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.288561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.288561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:38.288561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.288561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:38.402545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:38.404031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:38.404266 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:38.404498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.405319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:38.405319 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.405319 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:38.405319 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.405319 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.405319 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:38.405319 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.405319 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.407115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.407723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:38.456854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:38.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:38.458284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:38.458677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.459561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:38.459561 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.459561 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:38.459561 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.459561 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.459561 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:38.459561 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.459561 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:38.460605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.461175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:38.461697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.462246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.463589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:38.463589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.463589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:38.535540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:38.536082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:38.536960 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:38.537406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.538301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:38.538301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.538301 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:38.538301 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.538301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.538301 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:38.538301 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.538301 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:38.539638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:38.540225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:38.540225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.540225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:38.540225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.540225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.540225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:38.540225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.540225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:38.540994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.541475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:38.542089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.542089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:38.658026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:38.658703 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:38.659449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:38.659858 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:38.660158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.661059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:38.661059 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.661059 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:38.661059 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.661059 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.661059 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:38.661059 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.661059 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.662163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:38.663419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:43.247739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:43.249636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:43.251999 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:28:43.285909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:43.286422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.287328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:43.287328 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.287328 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:43.287328 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.287328 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.287328 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:43.287328 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.287328 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.288384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.289386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:43.403602 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:43.404962 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:43.405302 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:43.405573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.406427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:43.406427 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.406427 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:43.406427 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.406427 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.406427 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:43.406427 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.406427 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.408221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.408712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:43.457636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:43.458399 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:43.459206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:43.459575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.460628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:43.460628 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.460628 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:43.460628 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.460628 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.460628 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:43.460628 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.460628 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:43.462125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.462583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:43.463796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.464266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.464737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:43.464737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.464737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:43.536348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:43.536809 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:43.537482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:43.537975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.538842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:43.538842 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.538842 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:43.538842 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.538842 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.538842 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:43.538842 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.538842 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:43.540081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:43.541111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:43.541111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.541111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:43.541111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.541111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.541111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:43.541111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.541111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:43.541820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.542845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:43.543997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.543997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:43.658856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:43.659650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:43.660386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:43.660921 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:43.661539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.662104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:43.662104 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.662104 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:43.662104 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.662104 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.662104 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:43.662104 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.662104 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.663343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:43.664200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:48.248662 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:48.251746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:48.297349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:48.297576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.298322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:48.298322 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.298322 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:48.298322 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.298322 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.298322 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:48.298322 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.298322 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.299607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.300504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:48.404453 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:48.406154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:48.406483 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:48.406937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.407688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:48.407688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.407688 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:48.407688 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.407688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.407688 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:48.407688 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.407688 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.409465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.410978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:48.458502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:48.459070 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:48.459711 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:48.460107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.461028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:48.461028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.461028 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:48.461028 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.461028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.461028 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:48.461028 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.461028 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:48.462039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.462683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:48.463143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.463817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.464840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:48.464840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.464840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:48.537191 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:48.537857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:48.538491 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:48.538897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.539783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:48.539783 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.539783 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:48.539783 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.539783 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.539783 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:48.539783 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.539783 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:48.540717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:48.541610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:48.541610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.541610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:48.541610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.541610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.541610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:48.541610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.541610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:48.542033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.542779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:48.543755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.543755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:48.659701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:48.660607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:48.661452 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:48.662147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:48.662758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.664059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Traceback (most recent call last):
Mar 19 18:28:48.664059 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.664059 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:48.664059 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.664059 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.664059 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:48.664059 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.664059 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-91e3f31a-3340-48d4-92b3-dbef0613fb5c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.666154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:48.666764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:53.249445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:53.251175 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:53.285868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:53.286157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.287009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:53.287009 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.287009 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:53.287009 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.287009 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.287009 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:53.287009 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.287009 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.288304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.288778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:53.405379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:53.407224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:53.407586 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:53.407901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.408960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:53.408960 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.408960 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:53.408960 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.408960 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.408960 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:53.408960 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.408960 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.410649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.411759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:53.459196 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:53.459973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:53.460792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:53.461162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.462326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:53.462326 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.462326 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:53.462326 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.462326 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.462326 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:53.462326 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.462326 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:53.463305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.464164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:53.464795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.466001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.466907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:53.466907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.466907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:53.538199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:53.538568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:53.539419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:53.540024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.541101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:53.541101 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.541101 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:53.541101 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.541101 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.541101 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:53.541101 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.541101 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:53.542412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:53.543132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:53.543132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.543132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:53.543132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.543132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.543132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:53.543132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.543132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:53.544265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.545041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:53.545848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.545848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:53.660501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:53.661376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:53.662270 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:53.662652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:53.662873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.663840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:53.663840 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.663840 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:53.663840 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.663840 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.663840 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:53.663840 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.663840 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.665162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:53.666130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:58.250413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:58.252815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:58.287345 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:58.287641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.288373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:28:58.288373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.288373 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:58.288373 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.288373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.288373 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:58.288373 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.288373 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.289305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.290603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:58.406291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:58.407592 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:58.407849 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:58.408050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.409019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:58.409019 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.409019 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:58.409019 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.409019 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.409019 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:58.409019 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.409019 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.410430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.410981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:58.460148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:58.460516 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:28:58.461517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:58.462001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.463363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:28:58.463363 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.463363 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:58.463363 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.463363 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.463363 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:58.463363 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.463363 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:58.465504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.466149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:28:58.467146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.467828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.468679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:58.468679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.468679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:58.538855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:58.539509 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:58.540535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:58.541137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.542162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:58.542162 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.542162 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:58.542162 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.542162 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.542162 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:58.542162 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.542162 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:28:58.543859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:58.544277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:28:58.544277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.544277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:28:58.544277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.544277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.544277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:28:58.544277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.544277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:28:58.545678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.546089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:58.546502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.546502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:28:58.661330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:28:58.662151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:28:58.662862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:58.663390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:28:58.663639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.664607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:28:58.664607 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.664607 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:28:58.664607 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.664607 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.664607 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:28:58.664607 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.664607 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.666442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:28:58.667088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:03.251648 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:03.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:03.289480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:03.290042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.291195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:03.291195 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.291195 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:03.291195 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.291195 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.291195 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:03.291195 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.291195 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.292166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.293225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:03.407165 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:03.408855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:03.409308 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:03.409573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.410665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:03.410665 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.410665 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:03.410665 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.410665 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.410665 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:03.410665 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.410665 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.412948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.413939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:03.460707 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:03.461327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:03.462132 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:03.462468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.463418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:03.463418 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.463418 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:03.463418 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.463418 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.463418 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:03.463418 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.463418 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:03.464683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.465444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:03.465908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.466696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.467588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:03.467588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.467588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:03.539761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:03.541833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:03.541833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:03.541833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.541960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:03.541960 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.541960 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:03.541960 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.541960 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.541960 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:03.541960 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.541960 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:03.542860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:03.543275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:03.543275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.543275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:03.543275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.543275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.543275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:03.543275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.543275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:03.543900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.544326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:03.544789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.544789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:03.662008 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:03.662511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:03.663536 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:03.663822 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:03.663982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.664749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:03.664749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.664749 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:03.664749 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.664749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.664749 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:03.664749 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.664749 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.666623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:03.667516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:08.252417 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:08.254434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:08.296256 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:08.296419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.296922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:08.296922 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.296922 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:08.296922 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.296922 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.296922 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:08.296922 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.296922 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.297736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.298236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:08.407997 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:08.409809 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:08.410180 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:08.410429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.411667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:08.411667 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.411667 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:08.411667 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.411667 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.411667 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:08.411667 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.411667 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.413465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.414418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:08.461251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:08.461943 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:08.462448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:08.462701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.463603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:08.463603 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.463603 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:08.463603 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.463603 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.463603 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:08.463603 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.463603 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:08.465355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.466387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:08.467491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.468353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.469203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:08.469203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.469203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:08.540439 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:08.540719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:08.541781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:08.542316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.543429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:08.543429 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.543429 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:08.543429 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.543429 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.543429 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:08.543429 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.543429 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:08.544796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:08.545548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:08.545548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.545548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:08.545548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.545548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.545548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:08.545548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.545548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:08.546537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.547459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:08.548396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.548396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:08.662698 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:08.663273 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:08.663842 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:08.664328 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:08.664599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.665737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:08.665737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.665737 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:08.665737 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.665737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.665737 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:08.665737 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.665737 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.667181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:08.667827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:13.254341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:13.256049 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:13.298736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:13.299154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.300018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:13.300018 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.300018 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:13.300018 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.300018 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.300018 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:13.300018 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.300018 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.301207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.301837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:13.409048 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:13.410519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:13.410837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:13.411038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.411837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:13.411837 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.411837 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:13.411837 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.411837 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.411837 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:13.411837 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.411837 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.413202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.413552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:13.461984 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:13.462983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:13.463457 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:13.463830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.464776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:13.464776 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.464776 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:13.464776 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.464776 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.464776 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:13.464776 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.464776 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:13.465573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.465965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:13.466310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.466652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.467029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:13.467029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.467029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:13.541043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:13.541611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:13.542621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:13.543078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.544266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:13.544266 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.544266 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:13.544266 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.544266 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.544266 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:13.544266 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.544266 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:13.545239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:13.545635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:13.545635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.545635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:13.545635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.545635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.545635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:13.545635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.545635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:13.546604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.547020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:13.547414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.547414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:13.663502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:13.664289 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:13.665187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:13.665596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:13.665825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.666839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:13.666839 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.666839 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:13.666839 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.666839 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.666839 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:13.666839 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.666839 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.668270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:13.668773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:18.255460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:18.256978 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:18.291841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:18.292634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.293340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:18.293340 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.293340 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:18.293340 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.293340 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.293340 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:18.293340 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.293340 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.294595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.295518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:18.409772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:18.411621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:18.412701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:18.412701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.413681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:18.413681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.413681 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:18.413681 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.413681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.413681 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:18.413681 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.413681 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.415084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.416259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:18.462655 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:18.463413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:18.464411 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:18.464794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.465830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:18.465830 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.465830 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:18.465830 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.465830 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.465830 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:18.465830 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.465830 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:18.467369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.468236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:18.469484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.470192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.471046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:18.471046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.471046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:18.541812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:18.542484 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:18.543841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:18.544350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.545825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:18.545825 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.545825 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:18.545825 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.545825 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.545825 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:18.545825 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.545825 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:18.547415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:18.548200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:18.548200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.548200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:18.548200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.548200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.548200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:18.548200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.548200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:18.549979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.550701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:18.551647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.551647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:18.664302 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:18.665080 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:18.665939 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:18.666265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:18.666446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.667254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:18.667254 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.667254 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:18.667254 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.667254 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.667254 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:18.667254 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.667254 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.669142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:18.669977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:23.256491 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:23.258264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:23.297353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:23.297594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.299666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:23.299666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.299666 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:23.299666 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.299666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.299666 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:23.299666 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.299666 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.301561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.302630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:23.410913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:23.412998 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:23.413347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:23.413599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.414464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:23.414464 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.414464 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:23.414464 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.414464 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.414464 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:23.414464 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.414464 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.415806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.416320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:23.463216 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:23.463976 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:23.465243 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:23.465523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.466515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:23.466515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.466515 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:23.466515 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.466515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.466515 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:23.466515 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.466515 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:23.467761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.468259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:23.469727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.470221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.470745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:23.470745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.470745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:23.542784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:23.543131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:23.544182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:23.544790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.546131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:23.546131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.546131 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:23.546131 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.546131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.546131 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:23.546131 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.546131 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:23.547312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:23.548118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:23.548118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.548118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:23.548118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.548118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.548118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:23.548118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.548118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:23.548708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.549512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:23.550343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.550343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:23.665112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:23.665909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:23.666840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:23.667332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:23.667589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.668555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:23.668555 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.668555 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:23.668555 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.668555 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.668555 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:23.668555 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.668555 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.670376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:23.671210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:28.257277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:28.259318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:28.299445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:28.299863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.300991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:28.300991 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.300991 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:28.300991 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.300991 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.300991 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:28.300991 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.300991 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.302315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.302791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:28.412006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:28.413748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:28.414317 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:28.414600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.415808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:28.415808 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.415808 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:28.415808 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.415808 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.415808 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:28.415808 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.415808 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.417660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.418460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:28.464233 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:28.464848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:28.465566 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:28.465901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.466594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:28.466594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.466594 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:28.466594 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.466594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.466594 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:28.466594 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.466594 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:28.467465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.467970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:28.468519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.469010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.469622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:28.469622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.469622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:28.543346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:28.543635 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:28.544558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:28.545075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.546024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:28.546024 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.546024 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:28.546024 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.546024 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.546024 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:28.546024 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.546024 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:28.547395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:28.548040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:28.548040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.548040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:28.548040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.548040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.548040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:28.548040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.548040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:28.549028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.549943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:28.550695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.550695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:28.666121 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:28.666698 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:28.667244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:28.667544 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:28.667717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.668428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:28.668428 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.668428 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:28.668428 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.668428 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.668428 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:28.668428 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.668428 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.670378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:28.671445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:33.258249 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:33.260386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:33.306383 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:33.306687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.307648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:33.307648 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.307648 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:33.307648 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.307648 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.307648 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:33.307648 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.307648 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.308983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.310197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:33.412860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:33.414406 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:33.414977 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:33.415261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.417000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:33.417000 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.417000 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:33.417000 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.417000 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.417000 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:33.417000 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.417000 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.418944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.419869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:33.466364 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:33.467001 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:33.467789 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:33.468067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.468743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:33.468743 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.468743 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:33.468743 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.468743 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.468743 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:33.468743 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.468743 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:33.469588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:33.470592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.470979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.471729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:33.544273 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:33.544793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:33.545525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:33.545795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.546391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:33.546391 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.546391 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:33.546391 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.546391 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.546391 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:33.546391 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.546391 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:33.547139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:33.547844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:33.547844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.547844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:33.547844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.547844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.547844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:33.547844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.547844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:33.548220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.548869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:33.549676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.549676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:33.666950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:33.667776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:33.668491 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:33.668863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:33.669103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.669848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:33.669848 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.669848 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:33.669848 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.669848 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.669848 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:33.669848 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.669848 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.671329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:33.672212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:37.987788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:38.000452 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:389}}
Mar 19 18:29:38.000587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=103900) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:370}}
Mar 19 18:29:38.000728 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Fixing resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:29:38.044248 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, resource={'id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'name': 'private', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb', 'bee598c2-f62b-4321-b08d-23e3a7c6ccb9'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:09:27Z', 'updated_at': '2026-03-19T18:09:31Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 29513}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.044714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.045126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b55270e8-5359-4f54-8804-fcbd7769eee3, external_ids_update=None, columns={'tag': 29513}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.045329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.046432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:29:38.046432 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.046432 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.046432 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.046432 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.046432 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.046432 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.046432 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Failed to fix resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.048363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.048929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.049509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:29:38.049509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.049509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:29:38.049509 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Fixing resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:29:38.083211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, resource={'id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'name': 'public', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['7888df47-ce34-4091-9e08-c1c5949f53a2', 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-03-19T18:09:34Z', 'updated_at': '2026-03-19T18:09:44Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.083595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.084088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-20b6196a-9254-4b37-a645-8253845242a7, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.084649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.085571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:29:38.085571 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.085571 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.085571 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.085571 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.085571 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.085571 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.085571 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Failed to fix resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.087042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.087752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.088459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:29:38.088459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.088459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:29:38.088459 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Fixing resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:29:38.117253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-420e2995-aa57-46db-9651-85807f50bcb9, resource={'id': '420e2995-aa57-46db-9651-85807f50bcb9', 'name': 'admin_net', 'tenant_id': '1ed140779dbc462d89fd3e785886b2bb', 'project_id': '1ed140779dbc462d89fd3e785886b2bb', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['388b450f-f17e-4671-94e9-9f169d754be7'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:13:33Z', 'updated_at': '2026-03-19T18:13:34Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 28229}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.117858 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-420e2995-aa57-46db-9651-85807f50bcb9, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.118519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-07b4049d-60f0-4621-a8e7-5dcac93308be, external_ids_update=None, columns={'tag': 28229}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.118519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.119354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:29:38.119354 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.119354 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.119354 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.119354 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.119354 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.119354 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.119354 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Failed to fix resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.120794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.121255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.121603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:29:38.121603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.121603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:29:38.121603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Fixing resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:29:38.153994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, resource={'id': '4d64a793-ee68-4a18-b938-f55304c6fcf6', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0bc68cc0-48dc-4abe-bbac-0a4f654efb2e'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:14:20Z', 'updated_at': '2026-03-19T18:14:21Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 59295}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.154450 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.155050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-42ff4b0a-bf0a-4937-bf0f-c8b42f68f267, external_ids_update=None, columns={'tag': 59295}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.155976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.156969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:29:38.156969 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.156969 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.156969 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.156969 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.156969 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.156969 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.156969 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Failed to fix resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.157991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.158374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.158843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:29:38.158843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.158843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:29:38.158843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Fixing resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:29:38.246790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, resource={'id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'enable_snat': True}, 'gw_port_id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-1id6n', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'ip_address': '172.24.5.52', 'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, {'ip_address': '2001:db8::2c3', 'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:25Z', 'revision_number': 3, 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89'}, resource_type=routers, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.247131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.247366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.247532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.247666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.248601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:29:38.248601 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.248601 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.248601 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.248601 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.248601 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.248601 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.248601 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.248987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Unable to update router cf5e0251-94c8-4bce-b873-648b8cc72809. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Failed to fix resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Mar 19 18:29:38.250659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:29:38.251404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:29:38.251950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Fixing resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:29:38.259407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:38.262934 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:38.352604 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.354834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.356709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:38.356709 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.356709 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.356709 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.356709 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.356709 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.356709 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.356709 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.357861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.358852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:38.414280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:38.419731 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.419963 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.420090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.421435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:38.421435 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.421435 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.421435 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.421435 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.421435 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.421435 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.421435 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.424587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.425100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:38.443212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, resource={'id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'name': '', 'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'project_id': '', 'mac_address': 'fa:16:3e:11:31:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000160124', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:24Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.443503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::2c3/64', '172.24.5.52/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.443812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=f319bf7e-5d34-47af-b620-bec8597c3819, lrouter_port=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.444109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.444715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:29:38.444715 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.444715 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.444715 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.444715 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.444715 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.444715 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.444715 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Failed to fix resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.445776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.446550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.447173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:29:38.447173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.447173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:29:38.447173 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Maintenance task: Synchronization completed (took 0.45 seconds)
Mar 19 18:29:38.466572 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:38.468494 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:38.468494 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.468494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.468937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:38.468937 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.468937 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.468937 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.468937 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.468937 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.468937 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.468937 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:38.470667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.471539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:38.472641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.473430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.474370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:38.474370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.474370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:38.544847 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:38.545627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:38.546259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.546642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.547601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:38.547601 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.547601 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.547601 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.547601 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.547601 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.547601 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.547601 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:38.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.549504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:38.549504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.549504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:38.549504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.549504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.549504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:38.549504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.549504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:38.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.551029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:38.551934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.551934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:38.667708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:38.668589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:38.669422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.669850 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:38.670165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.671205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:38.671205 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.671205 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:38.671205 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.671205 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.671205 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:38.671205 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.671205 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.672684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:38.673177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:43.260382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:43.262163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:43.264438 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=434 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:29:43.304719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:43.305173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:43.306247 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.306247 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:43.306247 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.306247 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.306247 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:43.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.306247 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.307608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.308175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:43.414407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:43.416186 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:43.416502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:43.416750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.417735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:43.417735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.417735 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:43.417735 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.417735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.417735 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:43.417735 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.417735 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.419463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.420396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:43.467684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:43.468021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:43.468985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:43.469309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.470218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:43.470218 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.470218 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:43.470218 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.470218 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.470218 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:43.470218 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.470218 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:43.471330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.472109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:43.472778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.473345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.473857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:43.473857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.473857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:43.545598 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:43.546250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:43.547104 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:43.547720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.549052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:43.549052 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.549052 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:43.549052 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.549052 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.549052 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:43.549052 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.549052 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:43.549627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.550812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:43.551931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.552924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:43.668611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:43.669168 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:43.670213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:43.671143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:43.671369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.672419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:43.672419 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.672419 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:43.672419 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.672419 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.672419 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:43.672419 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.672419 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.674232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:43.675080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:48.261217 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:48.263548 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:48.306440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:48.306947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.307898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:48.307898 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.307898 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:48.307898 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.307898 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.307898 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:48.307898 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.307898 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.308858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.309532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:48.415342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:48.417103 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:48.418063 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:48.419696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.420578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:48.420578 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.420578 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:48.420578 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.420578 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.420578 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:48.420578 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.420578 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.422033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.423097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:48.468263 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:48.468661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:48.469618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:48.470143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.471112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:48.471112 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.471112 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:48.471112 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.471112 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.471112 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:48.471112 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.471112 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:48.472555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.473792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:48.474705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.475417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.476202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:48.476202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.476202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:48.546613 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:48.547448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:48.548405 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:48.548826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.549915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:29:48.549915 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.549915 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:48.549915 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.549915 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.549915 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:48.549915 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.549915 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:48.551428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.552254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:48.553225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.554113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:48.554954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.554954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:48.669481 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:48.669968 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:48.671441 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:48.671968 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:48.672263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.673223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:48.673223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.673223 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:48.673223 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.673223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.673223 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:48.673223 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.673223 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.674653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:48.675250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:53.261862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:53.263925 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:53.306805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:53.307035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.308042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:53.308042 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.308042 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:53.308042 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.308042 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.308042 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:53.308042 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.308042 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.309896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.310741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:53.416204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:53.418050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:53.418430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:53.418687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.419649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:53.419649 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.419649 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:53.419649 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.419649 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.419649 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:53.419649 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.419649 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.421250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.422236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:53.468866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:53.469665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:53.470771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:53.471151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.472187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:53.472187 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.472187 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:53.472187 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.472187 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.472187 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:53.472187 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.472187 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:53.473610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.474798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:53.475312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.476104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.476810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:53.476810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.476810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:53.547413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:53.548175 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:53.549183 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:53.549461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.550350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:29:53.550350 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.550350 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:53.550350 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.550350 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.550350 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:53.550350 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.550350 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:53.551834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.553012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:53.554484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.555535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:53.556418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.556418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:53.670430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:53.671279 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:53.672549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:53.672907 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:53.673160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.674189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:53.674189 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.674189 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:53.674189 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.674189 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.674189 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:53.674189 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.674189 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.676464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:53.677347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:58.262732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:58.264378 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:58.300848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:58.301224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.302048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:29:58.302048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.302048 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:58.302048 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.302048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.302048 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:58.302048 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.302048 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.302938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.303778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:58.417016 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:58.418678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:58.419121 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:58.419385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.420597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:58.420597 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.420597 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:58.420597 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.420597 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.420597 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:58.420597 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.420597 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.422625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.423328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:58.470143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:58.470651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:29:58.471550 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:58.471925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.472793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:29:58.472793 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.472793 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:58.472793 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.472793 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.472793 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:58.472793 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.472793 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:58.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.474672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:29:58.475197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.475952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.476748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:58.476748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.476748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:58.548422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:58.549204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:58.549915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:58.550403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.551303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:29:58.551303 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.551303 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:58.551303 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.551303 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.551303 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:58.551303 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.551303 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:29:58.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:29:58.553330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.554101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:58.555269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.555269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:29:58.671489 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:29:58.673035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:29:58.673977 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:58.674521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:29:58.675021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.675777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:29:58.675777 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.675777 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:29:58.675777 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.675777 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.675777 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:29:58.675777 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.675777 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.677654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:29:58.678571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:03.263616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:03.265495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:03.308350 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:03.308703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.309409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:03.309409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.309409 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:03.309409 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.309409 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.309409 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:03.309409 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.309409 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.311042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.311665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:03.417920 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:03.419670 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:03.420158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:03.420506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.421687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:03.421687 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.421687 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:03.421687 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.421687 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.421687 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:03.421687 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.421687 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.423826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.424681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:03.470784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:03.472158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:03.473416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:03.473987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.475335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:03.475335 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.475335 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:03.475335 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.475335 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.475335 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:03.475335 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.475335 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:03.476490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.476986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:03.477750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.478192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.478688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:03.478688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.478688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:03.549303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:03.550047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:03.550893 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:03.551278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.552207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:03.552207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.552207 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:03.552207 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.552207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.552207 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:03.552207 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.552207 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:03.553325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:03.554326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:03.555101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.556328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:03.672532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:03.673306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:03.674678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:03.675139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:03.675349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.676382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:03.676382 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.676382 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:03.676382 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.676382 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.676382 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:03.676382 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.676382 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.678008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:03.679371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:08.264419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:08.265976 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:08.302940 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:08.303145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.303532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:08.303532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.303532 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:08.303532 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.303532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.303532 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:08.303532 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.303532 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.304345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.305121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:08.418795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:08.420867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:08.421313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:08.421580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.422804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:08.422804 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.422804 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:08.422804 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.422804 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.422804 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:08.422804 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.422804 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.424787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.425346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:08.471545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:08.472086 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:08.472763 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:08.473143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.474141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:08.474141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.474141 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:08.474141 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.474141 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.474141 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:08.474141 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.474141 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:08.475586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.476494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:08.477259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.478294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.479199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:08.479199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.479199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:08.550259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:08.550804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:08.551638 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:08.552128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.553090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:08.553090 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.553090 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:08.553090 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.553090 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.553090 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:08.553090 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.553090 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:08.554695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.555195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:08.556398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.557190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:08.557838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.557838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:08.673207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:08.674040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:08.674641 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:08.675222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:08.675222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.675928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:08.675928 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.675928 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:08.675928 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.675928 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.675928 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:08.675928 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.675928 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.677204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:08.678176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:13.265254 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:13.266853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:13.305341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:13.305560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.306194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:13.306194 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.306194 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:13.306194 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.306194 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.306194 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:13.306194 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.306194 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.307251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.307913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:13.419768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:13.421456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:13.421846 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:13.422146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.423151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:13.423151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.423151 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:13.423151 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.423151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.423151 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:13.423151 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.423151 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.424923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.426288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:13.472420 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:13.472830 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:13.473539 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:13.473913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.475013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:13.475013 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.475013 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:13.475013 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.475013 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.475013 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:13.475013 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.475013 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:13.476582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.477457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:13.478262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.479121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.480030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:13.480030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.480030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:13.550966 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:13.551642 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:13.552307 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:13.552754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.553726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:13.553726 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.553726 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:13.553726 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.553726 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.553726 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:13.553726 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.553726 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:13.555153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.555910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:13.557035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.558040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:13.558946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.558946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:13.674126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:13.674867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:13.675803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:13.676298 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:13.676475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.677279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:13.677279 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.677279 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:13.677279 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.677279 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.677279 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:13.677279 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.677279 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.679173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:13.679570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:18.266220 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:18.268326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:18.306908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:18.307240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.308134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:18.308134 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.308134 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:18.308134 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.308134 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.308134 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:18.308134 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.308134 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.309416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.310035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:18.420578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:18.421762 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:18.422064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:18.422178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.422790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:18.422790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.422790 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:18.422790 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.422790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.422790 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:18.422790 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.422790 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.424698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.425718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:18.473170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:18.473579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:18.474473 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:18.474780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.475575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:18.475575 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.475575 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:18.475575 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.475575 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.475575 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:18.475575 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.475575 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:18.477043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.477991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:18.478636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.479369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.480196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:18.480196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.480196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:18.551768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:18.552671 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:18.553401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:18.554063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.555135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:18.555135 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.555135 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:18.555135 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.555135 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.555135 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:18.555135 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.555135 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:18.556244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.556994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:18.557563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.558478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:18.559304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.559304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:18.675056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:18.676060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:18.676867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:18.677187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:18.677400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.678197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:18.678197 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.678197 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:18.678197 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.678197 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.678197 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:18.678197 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.678197 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.679969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:18.680833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:23.267156 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:23.269078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:23.307940 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:23.308404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.309595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:23.309595 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.309595 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:23.309595 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.309595 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.309595 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:23.309595 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.309595 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.310973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.311862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:23.421423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:23.423668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:23.424169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:23.424498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.425639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:23.425639 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.425639 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:23.425639 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.425639 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.425639 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:23.425639 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.425639 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.427578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.428654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:23.474080 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:23.474929 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:23.475549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:23.475953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.476859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:23.476859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.476859 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:23.476859 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.476859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.476859 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:23.476859 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.476859 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:23.478624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.479486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:23.481028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.481704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.482248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:23.482248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.482248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:23.552735 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:23.553418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:23.554598 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:23.555454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.556490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:23.556490 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.556490 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:23.556490 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.556490 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.556490 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:23.556490 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.556490 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:23.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.558807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:23.559695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.560513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:23.561346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.561346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:23.675815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:23.676532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:23.677265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:23.677982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:23.678296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.679274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:23.679274 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.679274 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:23.679274 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.679274 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.679274 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:23.679274 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.679274 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.681023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:23.681973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:28.267870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:28.269646 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:28.309434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:28.309872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:28.310920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.310920 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:28.310920 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.310920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.310920 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:28.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.310920 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.312212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.313499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:28.422228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:28.423403 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:28.423706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:28.423891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.424778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:28.424778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.424778 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:28.424778 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.424778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.424778 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:28.424778 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.424778 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.426189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.426748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:28.474847 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:28.475381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:28.476006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:28.476280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.477060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:28.477060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.477060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:28.477060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.477060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.477060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:28.477060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.477060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:28.478276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.478781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:28.480002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.480442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.480944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:28.480944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.480944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:28.553401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:28.554138 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:28.555326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:28.555732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.556772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:28.556772 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.556772 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:28.556772 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.556772 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.556772 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:28.556772 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.556772 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:28.557788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.558781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:28.559250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.560038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:28.560798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.560798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:28.676643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:28.677399 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:28.677909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:28.678206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:28.678362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.679027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:28.679027 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.679027 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:28.679027 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.679027 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.679027 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:28.679027 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.679027 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.680527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:28.681386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:33.268681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:33.270585 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:33.309737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:33.310306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.311685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:33.311685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.311685 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:33.311685 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.311685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.311685 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:33.311685 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.311685 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.313653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.314384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:33.423091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:33.424836 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:33.425367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:33.425660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.426805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:33.426805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.426805 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:33.426805 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.426805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.426805 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:33.426805 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.426805 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.428236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.429123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:33.475540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:33.476179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:33.476921 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:33.477624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.479296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:33.479296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.479296 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:33.479296 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.479296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.479296 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:33.479296 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.479296 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:33.481073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.481793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:33.483396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.484012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.484690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:33.484690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.484690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:33.554085 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:33.555011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:33.555893 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:33.556373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.557405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:33.557405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.557405 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:33.557405 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.557405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.557405 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:33.557405 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.557405 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:33.558905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.559645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:33.560477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.561230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:33.562051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.562051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:33.677550 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:33.678268 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:33.679153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:33.679782 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:33.680200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.681128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:33.681128 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.681128 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:33.681128 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.681128 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.681128 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:33.681128 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.681128 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.683020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:33.684009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:38.269712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:38.271783 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:38.308158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:38.308655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.309744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:38.309744 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.309744 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:38.309744 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.309744 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.309744 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:38.309744 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.309744 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.311013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.312038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:38.423845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:38.425590 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:38.426059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:38.426253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.427357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:38.427357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.427357 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:38.427357 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.427357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.427357 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:38.427357 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.427357 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.429248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.430073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:38.476325 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:38.477057 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:38.477653 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:38.477964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.478735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:38.478735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.478735 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:38.478735 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.478735 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.478735 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:38.478735 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.478735 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:38.480319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.481123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:38.482075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.482869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.483761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:38.483761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.483761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:38.555235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:38.556236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:38.557168 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:38.557568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.559688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:38.559688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.559688 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:38.559688 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.559688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.559688 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:38.559688 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.559688 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:38.562325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.562860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:38.563757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.564261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:38.565101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.565101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:38.678236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:38.678963 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:38.679874 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:38.680398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:38.680690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.681695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:38.681695 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.681695 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:38.681695 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.681695 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.681695 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:38.681695 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.681695 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.683467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:38.684313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:43.270603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:43.272537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:43.274786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:30:43.313572 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:43.314278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.315500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:43.315500 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.315500 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:43.315500 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.315500 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.315500 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:43.315500 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.315500 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.316862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.317510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:43.424654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:43.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:43.426656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:43.426936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.428118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:43.428118 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.428118 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:43.428118 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.428118 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.428118 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:43.428118 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.428118 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.430098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.431024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:43.477125 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:43.477875 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:43.478521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:43.479276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.479574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:43.479574 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.479574 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:43.479574 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.479574 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.479574 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:43.479574 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.479574 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:43.481061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.481653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:43.482709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.483358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.484110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:43.484110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.484110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:43.556331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:43.557295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:43.558420 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:43.558605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.559554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:43.559554 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.559554 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:43.559554 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.559554 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.559554 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:43.559554 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.559554 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:43.561201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.561770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:43.562952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.563591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:43.564212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.564212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:43.679094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:43.679984 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:43.680684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:43.681268 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:43.681524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.682464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:43.682464 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.682464 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:43.682464 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.682464 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.682464 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:43.682464 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.682464 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.684345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:43.684981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:48.271476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:48.273709 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:48.315537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:48.315861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.316670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:48.316670 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.316670 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:48.316670 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.316670 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.316670 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:48.316670 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.316670 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.317775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.318408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:48.425630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:48.427231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:48.427642 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:48.427972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.429140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:48.429140 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.429140 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:48.429140 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.429140 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.429140 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:48.429140 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.429140 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.431007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.432095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:48.477961 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:48.478609 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:48.479416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:48.479731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.481082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:48.481082 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.481082 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:48.481082 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.481082 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.481082 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:48.481082 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.481082 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:48.482259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.482985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:48.483730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.484447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.485213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:48.485213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.485213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:48.557483 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:48.558800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:48.559822 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:48.560632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.561434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:48.561434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.561434 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:48.561434 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.561434 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.561434 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:48.561434 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.561434 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:48.562905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.563458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:48.564649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.565458 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:48.566116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.566116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:48.679826 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:48.680595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:48.681176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:48.681525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:48.681715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.682484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:48.682484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.682484 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:48.682484 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.682484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.682484 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:48.682484 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.682484 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.684242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:48.685245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:53.272528 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:53.273914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:53.314952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:53.315788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.316467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:53.316467 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.316467 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:53.316467 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.316467 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.316467 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:53.316467 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.316467 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.317989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.318808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:53.426472 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:53.428397 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:53.429140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:53.429140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.430179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:53.430179 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.430179 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:53.430179 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.430179 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.430179 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:53.430179 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.430179 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.432345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.433657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:53.478438 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:53.478952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:53.479785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:53.480135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.481223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:53.481223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.481223 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:53.481223 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.481223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.481223 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:53.481223 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.481223 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:53.482739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.483695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:53.484576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.485424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.486329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:53.486329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.486329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:53.558522 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:53.559041 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:53.560210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:53.560663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.561623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:53.561623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.561623 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:53.561623 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.561623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.561623 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:53.561623 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.561623 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:53.562637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.563379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:53.563769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.564636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:53.565566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.565566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:53.680537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:53.681461 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:53.682214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:53.682590 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:53.682836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.683650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:53.683650 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.683650 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:53.683650 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.683650 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.683650 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:53.683650 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.683650 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.685273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:53.686192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:58.273154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:58.275245 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:58.313230 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:58.313625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.314683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:30:58.314683 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.314683 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:58.314683 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.314683 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.314683 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:58.314683 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.314683 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.316037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.317513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:58.427355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:58.428889 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:58.429361 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:58.429551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.430778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:58.430778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.430778 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:58.430778 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.430778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.430778 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:58.430778 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.430778 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.432860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.433722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:58.478982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:58.479428 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:30:58.479989 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:58.480225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.480908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:30:58.480908 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.480908 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:58.480908 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.480908 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.480908 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:58.480908 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.480908 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:58.481784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.482603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:30:58.483078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.483803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.484719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:58.484719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.484719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:58.559267 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:58.559900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:58.561154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:58.561691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.562778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:30:58.562778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.562778 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:58.562778 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.562778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.562778 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:58.562778 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.562778 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:30:58.564176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.564981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:30:58.565798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.566607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:58.567453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.567453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:30:58.681362 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:30:58.682385 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:30:58.683561 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:58.684248 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:30:58.685027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.685755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:30:58.685755 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.685755 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:30:58.685755 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.685755 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.685755 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:30:58.685755 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.685755 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.687816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:30:58.688681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:03.273919 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:03.275985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:03.312237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:03.312646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.313869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:03.313869 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.313869 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:03.313869 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.313869 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.313869 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:03.313869 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.313869 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.315487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.316410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:03.428296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:03.430201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:03.430478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:03.430758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.431981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:03.431981 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.431981 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:03.431981 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.431981 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.431981 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:03.431981 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.431981 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.433779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.434664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:03.479595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:03.480539 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:03.481275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:03.481604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.482554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:03.482554 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.482554 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:03.482554 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.482554 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.482554 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:03.482554 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.482554 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:03.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.484698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:03.485380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.486272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.487140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:03.487140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.487140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:03.559913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:03.560661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:03.561170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:03.561508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.562223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:03.562223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.562223 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:03.562223 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.562223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.562223 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:03.562223 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.562223 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:03.563331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.563762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:03.564106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.565122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:03.566029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.566029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:03.682230 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:03.683213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:03.684221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:03.684681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:03.684904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.686126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:03.686126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.686126 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:03.686126 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.686126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.686126 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:03.686126 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.686126 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.688054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:03.688868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:08.274838 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:08.276856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:08.310329 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:08.310659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.311710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:08.311710 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.311710 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:08.311710 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.311710 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.311710 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:08.311710 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.311710 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.313594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.314420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:08.429078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:08.430578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:08.430986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:08.431260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.432383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:08.432383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.432383 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:08.432383 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.432383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.432383 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:08.432383 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.432383 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.434222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.435779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:08.480523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:08.481212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:08.481775 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:08.482126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.482986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:08.482986 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.482986 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:08.482986 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.482986 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.482986 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:08.482986 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.482986 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:08.484203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.484972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:08.485846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.486646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.487540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:08.487540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.487540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:08.560832 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:08.561761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:08.562416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:08.562852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.563763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:08.563763 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.563763 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:08.563763 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.563763 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.563763 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:08.563763 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.563763 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:08.564574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:08.565648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:08.566751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.568158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:08.683185 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:08.683959 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:08.684837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:08.685300 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:08.685503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.686430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:08.686430 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.686430 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:08.686430 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.686430 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.686430 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:08.686430 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.686430 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.688485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:08.689078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:13.275705 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:13.277782 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:13.316905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:13.316905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.318176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:13.318176 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.318176 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:13.318176 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.318176 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.318176 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:13.318176 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.318176 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.319446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.319854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:13.430206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:13.431654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:13.432130 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:13.432406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.433594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:13.433594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.433594 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:13.433594 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.433594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.433594 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:13.433594 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.433594 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.435549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.436284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:13.481355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:13.481975 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:13.482517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:13.482854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:13.483727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.483727 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:13.483727 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.483727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.483727 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:13.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.483727 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:13.485040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.485828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:13.486644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.487459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.488451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:13.488451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.488451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:13.561785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:13.562482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:13.563465 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:13.564004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.564927 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:13.564927 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.564927 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:13.564927 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.564927 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.564927 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:13.564927 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.564927 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:13.566200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.567267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:13.568006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.568820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:13.569753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.569753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:13.684040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:13.684801 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:13.685812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:13.686323 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:13.686562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.687700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:13.687700 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.687700 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:13.687700 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.687700 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.687700 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:13.687700 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.687700 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.689270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:13.689979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:18.276472 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:18.278033 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:18.313327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:18.313662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.314570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:18.314570 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.314570 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:18.314570 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.314570 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.314570 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:18.314570 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.314570 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.315569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.316122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:18.430935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:18.433305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:18.433867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:18.435043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.435469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:18.435469 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.435469 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:18.435469 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.435469 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.435469 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:18.435469 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.435469 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.436900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.437669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:18.482186 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:18.482808 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:18.483528 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:18.483989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.485240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:18.485240 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.485240 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:18.485240 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.485240 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.485240 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:18.485240 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.485240 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:18.486653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.487570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:18.488113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.488919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.489802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:18.489802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.489802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:18.562659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:18.563532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:18.564658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:18.565179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.566206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:18.566206 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.566206 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:18.566206 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.566206 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.566206 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:18.566206 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.566206 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:18.567659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.568434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:18.570001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.571100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:18.571823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.571823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:18.685158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:18.685796 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:18.686700 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:18.687275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:18.687619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.688633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:18.688633 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.688633 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:18.688633 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.688633 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.688633 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:18.688633 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.688633 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.690631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:18.691542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:23.277633 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:23.279350 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:23.308425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:23.308645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.309393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:23.309393 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.309393 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:23.309393 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.309393 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.309393 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:23.309393 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.309393 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.311341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.312420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:23.432100 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:23.433690 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:23.434075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:23.434273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.435209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:23.435209 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.435209 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:23.435209 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.435209 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.435209 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:23.435209 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.435209 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.437229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.438077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:23.483082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:23.484075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:23.484702 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:23.485044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.485845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:23.485845 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.485845 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:23.485845 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.485845 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.485845 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:23.485845 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.485845 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:23.487407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.488302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:23.489239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.490290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.491280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:23.491280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.491280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:23.563715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:23.564415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:23.565203 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:23.565500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.566178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:23.566178 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.566178 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:23.566178 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.566178 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.566178 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:23.566178 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.566178 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:23.566977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.567635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:23.568026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.568727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:23.569511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.569511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:23.685853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:23.686823 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:23.687938 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:23.688575 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:23.688968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.690176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:23.690176 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.690176 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:23.690176 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.690176 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.690176 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:23.690176 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.690176 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.692103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:23.692654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:28.278443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:28.279939 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:28.318444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:28.318790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.319754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:28.319754 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.319754 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:28.319754 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.319754 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.319754 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:28.319754 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.319754 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.320624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.321368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:28.432834 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:28.434424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:28.434724 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:28.434898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.435748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:28.435748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.435748 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:28.435748 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.435748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.435748 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:28.435748 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.435748 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.437077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.437758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:28.484227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:28.484819 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:28.485799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:28.486274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.487273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:28.487273 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.487273 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:28.487273 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.487273 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.487273 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:28.487273 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.487273 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:28.488611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.489387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:28.490294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.491062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.491858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:28.491858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.491858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:28.564401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:28.564688 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:28.565769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:28.566319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.567346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:28.567346 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.567346 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:28.567346 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.567346 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.567346 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:28.567346 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.567346 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:28.568294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.568782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:28.569323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.569959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:28.570462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.570462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:28.686712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:28.687745 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:28.688601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:28.689082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:28.689342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.690441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:28.690441 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.690441 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:28.690441 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.690441 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.690441 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:28.690441 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.690441 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.692403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:28.693300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:33.279184 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:33.281243 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:33.320443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:33.320756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.321527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:33.321527 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.321527 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:33.321527 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.321527 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.321527 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:33.321527 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.321527 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.322541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.323465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:33.433789 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:33.435935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:33.436131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:33.436321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.437414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:33.437414 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.437414 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:33.437414 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.437414 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.437414 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:33.437414 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.437414 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.439442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.439893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:33.484773 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:33.485234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:33.486250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:33.486667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.487763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:33.487763 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.487763 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:33.487763 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.487763 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.487763 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:33.487763 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.487763 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:33.488906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.490008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:33.490493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.491297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.492412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:33.492412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.492412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:33.565160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:33.566094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:33.566790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:33.567083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.567773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:33.567773 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.567773 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:33.567773 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.567773 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.567773 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:33.567773 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.567773 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:33.568790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.569319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:33.569900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.570425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:33.571016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.571016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:33.688211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:33.688934 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:33.689430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:33.689806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:33.690091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.691036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:33.691036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.691036 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:33.691036 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.691036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.691036 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:33.691036 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.691036 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.692501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:33.693949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:38.280063 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:38.282213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:38.318373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:38.318687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.319594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:38.319594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.319594 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:38.319594 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.319594 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.319594 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:38.319594 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.319594 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.321533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.322480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:38.434854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:38.436301 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:38.436867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:38.436867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.437731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:38.437731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.437731 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:38.437731 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.437731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.437731 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:38.437731 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.437731 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.438843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.439712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:38.485409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:38.486397 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:38.487247 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:38.487501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.488410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:38.488410 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.488410 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:38.488410 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.488410 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.488410 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:38.488410 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.488410 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:38.489995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.490740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:38.491637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.492422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.493243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:38.493243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.493243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:38.566176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:38.566563 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:38.567056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:38.567330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.567975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:38.567975 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.567975 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:38.567975 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.567975 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.567975 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:38.567975 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.567975 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:38.568723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.569536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:38.570003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.570766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:38.571665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.571665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:38.689161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:38.689521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:38.690600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:38.691108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:38.691408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.692449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:38.692449 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.692449 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:38.692449 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.692449 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.692449 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:38.692449 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.692449 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.694427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:38.695239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:43.280929 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:43.282832 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:43.285147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:31:43.325914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:43.326543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.327668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:43.327668 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.327668 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:43.327668 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.327668 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.327668 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:43.327668 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.327668 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.328739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.329817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:43.435717 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:43.437221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:43.437584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:43.437830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.438713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:43.438713 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.438713 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:43.438713 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.438713 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.438713 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:43.438713 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.438713 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.440542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.441163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:43.486133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:43.486949 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:43.487519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:43.487810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.488954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:43.488954 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.488954 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:43.488954 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.488954 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.488954 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:43.488954 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.488954 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:43.490185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.491136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:43.491904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.492689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.493630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:43.493630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.493630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:43.567215 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:43.567839 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:43.568765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:43.569276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.570336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:43.570336 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.570336 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:43.570336 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.570336 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.570336 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:43.570336 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.570336 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:43.572022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.572919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:43.573812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.574597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:43.575547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.575547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:43.689902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:43.690688 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:43.691583 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:43.692043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:43.692296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.693277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:43.693277 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.693277 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:43.693277 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.693277 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.693277 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:43.693277 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.693277 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.695128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:43.695982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:48.281673 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:48.283028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:48.312731 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:48.313223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.314020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:48.314020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.314020 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:48.314020 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.314020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.314020 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:48.314020 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.314020 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.314794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.315813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:48.436403 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:48.437627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:48.437920 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:48.438024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.438802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:48.438802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.438802 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:48.438802 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.438802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.438802 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:48.438802 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.438802 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.440172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.440973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:48.486914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:48.487553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:48.488120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:48.488353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.489238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:48.489238 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.489238 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:48.489238 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.489238 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.489238 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:48.489238 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.489238 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:48.491055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:48.492846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.493684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.494543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:48.494543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.494543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:48.567793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:48.568482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:48.569060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:48.569296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.570020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:48.570020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.570020 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:48.570020 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.570020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.570020 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:48.570020 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.570020 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:48.571491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.572367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:48.573517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.574847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:48.575799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.575799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:48.690567 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:48.691206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:48.691672 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:48.691978 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:48.692145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.692793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:48.692793 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.692793 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:48.692793 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.692793 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.692793 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:48.692793 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.692793 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.694643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:48.695182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:53.282579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:53.286161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:53.317351 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:53.317669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.318522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:53.318522 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.318522 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:53.318522 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.318522 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.318522 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:53.318522 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.318522 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.320028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.321346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:53.437192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:53.438573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:53.439052 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:53.439305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.440242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:53.440242 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.440242 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:53.440242 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.440242 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.440242 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:53.440242 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.440242 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.441950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.442795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:53.487334 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:53.488163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:53.488909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:53.489316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.490372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:53.490372 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.490372 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:53.490372 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.490372 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.490372 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:53.490372 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.490372 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:53.491854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.492672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:53.493578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.494687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.495755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:53.495755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.495755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:53.568623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:53.569290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:53.570445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:53.570909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.572169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:53.572169 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.572169 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:53.572169 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.572169 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.572169 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:53.572169 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.572169 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:53.573728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.574501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:53.575907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.576742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:53.577659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.577659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:53.691236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:53.692028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:53.692926 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:53.693370 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:53.693653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.694530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:53.694530 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.694530 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:53.694530 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.694530 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.694530 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:53.694530 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.694530 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.697731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:53.698292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:58.283439 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:58.285758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:58.367922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:58.368322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.369311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:31:58.369311 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.369311 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:58.369311 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.369311 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.369311 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:58.369311 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.369311 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.370683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.372095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:58.438040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:58.439622 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:58.440040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:58.440268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.441226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:58.441226 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.441226 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:58.441226 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.441226 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.441226 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:58.441226 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.441226 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.443219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.444269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:58.488165 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:58.488593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:31:58.489546 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:58.489902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.490999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:31:58.490999 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.490999 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:58.490999 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.490999 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.490999 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:58.490999 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.490999 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:58.492409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.493040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:31:58.494045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.494665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.495556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:58.495556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.495556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:58.569218 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:58.569930 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:58.570516 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:58.570904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.571651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:31:58.571651 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.571651 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:58.571651 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.571651 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.571651 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:58.571651 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.571651 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:31:58.572538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.573042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:31:58.574495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.575012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:58.575523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.575523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:31:58.692086 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:31:58.693092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:31:58.693812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:58.694107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:31:58.694419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.695183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:31:58.695183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.695183 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:31:58.695183 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.695183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.695183 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:31:58.695183 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.695183 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.697019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:31:58.697920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:03.284235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:03.285856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:03.340280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:03.340280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.340572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:03.340572 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.340572 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:03.340572 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.340572 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.340572 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:03.340572 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.340572 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.341853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.342733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:03.438927 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:03.441576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:03.441576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:03.441576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.442002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:03.442002 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.442002 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:03.442002 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.442002 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.442002 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:03.442002 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.442002 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.443069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.443586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:03.488754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:03.489659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:03.491723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:03.491723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.492225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:03.492225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.492225 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:03.492225 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.492225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.492225 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:03.492225 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.492225 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:03.493344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.493934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:03.494810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.495365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.495911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:03.495911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.495911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:03.569928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:03.570618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.573580 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:03.575104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:03.576369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:03.577623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.579020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:03.693068 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:03.693757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:03.694994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:03.694994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:03.695371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.696954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:03.696954 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.696954 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:03.696954 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.696954 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.696954 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:03.696954 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.696954 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.698264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:03.698864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:08.284991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:08.287910 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:08.316126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:08.316423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.317350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:08.317350 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.317350 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:08.317350 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.317350 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.317350 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:08.317350 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.317350 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.318447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.318985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:08.439661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:08.440990 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:08.441201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:08.441357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.442573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:08.442573 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.442573 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:08.442573 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.442573 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.442573 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:08.442573 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.442573 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.444521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.445427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:08.489698 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:08.490283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:08.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:08.491863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.492111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:08.492111 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.492111 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:08.492111 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.492111 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.492111 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:08.492111 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.492111 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:08.493244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.493746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:08.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.494833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.495384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:08.495384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.495384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:08.570794 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:08.571327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:08.572644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:08.572644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.572775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:08.572775 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.572775 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:08.572775 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.572775 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.572775 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:08.572775 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.572775 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:08.573558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.574156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:08.574471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.575478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:08.576521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.576521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:08.693910 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:08.694974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:08.695448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:08.695825 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:08.696098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.696963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:08.696963 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.696963 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:08.696963 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.696963 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.696963 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:08.696963 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.696963 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.698586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:08.699023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:13.285766 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:13.287289 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:13.334425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:13.334425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.334826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:13.334826 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.334826 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:13.334826 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.334826 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.334826 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:13.334826 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.334826 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.336161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.336708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:13.462928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:13.462928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:13.462928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:13.462928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.463694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:13.463694 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.463694 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:13.463694 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.463694 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.463694 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:13.463694 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.463694 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.465041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.466042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:13.490376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:13.491196 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:13.492579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:13.492579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.492767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:13.492767 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.492767 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:13.492767 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.492767 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.492767 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:13.492767 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.492767 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:13.493535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:13.494634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.495615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.496199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:13.571324 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:13.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.577287 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:13.577993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.578405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:13.578840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.579522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:13.580055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.580055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:13.694839 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:13.695504 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:13.695967 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:13.696448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:13.696729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.697444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:13.697444 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.697444 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:13.697444 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.697444 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.697444 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:13.697444 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.697444 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.698846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:13.699951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:18.286497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:18.288392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:18.324543 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:18.324993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.325956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:18.325956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.325956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:18.325956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.325956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.325956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:18.325956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.325956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.326982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.327757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:18.460062 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:18.461406 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:18.461743 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:18.462022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.463064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:18.463064 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.463064 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:18.463064 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.463064 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.463064 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:18.463064 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.463064 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.464755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.465396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:18.491500 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:18.492172 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:18.493976 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:18.493976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.494144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:18.494144 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.494144 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:18.494144 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.494144 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.494144 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:18.494144 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.494144 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:18.495770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.496504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:18.497388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.498273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.499090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:18.499090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.499090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:18.575674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:18.576713 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:18.577648 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:18.578186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.579181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:18.579181 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.579181 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:18.579181 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.579181 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.579181 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:18.579181 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.579181 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:18.580114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.580763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:18.581253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.582142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:18.582971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.582971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:18.695547 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:18.696277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:18.696799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:18.697056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:18.697279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.697891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:18.697891 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.697891 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:18.697891 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.697891 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.697891 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:18.697891 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.697891 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.698896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:18.699471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:23.287855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:23.289671 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:23.328635 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:23.329046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.330124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:23.330124 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.330124 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:23.330124 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.330124 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.330124 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:23.330124 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.330124 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.331407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.332167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:23.460704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:23.461803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:23.462036 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:23.462192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.462724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:23.462724 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.462724 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:23.462724 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.462724 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.462724 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:23.462724 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.462724 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.463788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.464204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:23.491993 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:23.493785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:23.494109 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:23.494551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.495210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:23.495210 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.495210 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:23.495210 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.495210 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.495210 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:23.495210 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.495210 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:23.496279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.496642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:23.497376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.497757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.498158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:23.498158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.498158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:23.577017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:23.577720 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:23.578323 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:23.578623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.579383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:23.579383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.579383 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:23.579383 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.579383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.579383 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:23.579383 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.579383 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:23.580768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.581535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:23.582498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.583267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:23.583841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.583841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:23.696273 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:23.696759 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:23.697721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:23.698184 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:23.698439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.699480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:23.699480 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.699480 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:23.699480 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.699480 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.699480 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:23.699480 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.699480 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.700706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:23.701514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:28.288780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:28.290514 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:28.327136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:28.327481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.328357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:28.328357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.328357 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:28.328357 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.328357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.328357 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:28.328357 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.328357 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.329538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.331185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:28.462050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:28.463549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:28.463997 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:28.464370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.465903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:28.465903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.465903 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:28.465903 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.465903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.465903 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:28.465903 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.465903 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.467742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.468617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:28.492598 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:28.493615 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:28.494370 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:28.494697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.495757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:28.495757 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.495757 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:28.495757 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.495757 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.495757 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:28.495757 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.495757 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:28.497334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.498243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:28.499257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.500037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.501610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:28.501610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.501610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:28.577855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:28.578218 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:28.579069 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:28.579465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.580551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:28.580551 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.580551 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:28.580551 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.580551 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.580551 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:28.580551 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.580551 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:28.582174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.583028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:28.583975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.584786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:28.585298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.585298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:28.696860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:28.697653 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:28.698254 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:28.698732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:28.698965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.699780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:28.699780 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.699780 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:28.699780 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.699780 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.699780 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:28.699780 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.699780 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.701605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:28.702120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:33.289424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:33.291406 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:33.334821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:33.335452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.337051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:33.337051 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.337051 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:33.337051 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.337051 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.337051 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:33.337051 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.337051 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.338577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.339584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:33.462612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:33.464131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:33.464489 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:33.464731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.466015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:33.466015 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.466015 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:33.466015 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.466015 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.466015 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:33.466015 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.466015 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.467052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.468128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:33.493506 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:33.494118 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:33.494757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:33.495098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.496008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:33.496008 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.496008 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:33.496008 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.496008 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.496008 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:33.496008 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.496008 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:33.497634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.498421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:33.499415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.500160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.501016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:33.501016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.501016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:33.578314 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:33.578904 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:33.579826 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:33.580220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.580956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:33.580956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.580956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:33.580956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.580956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.580956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:33.580956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.580956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:33.581663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.582169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:33.582455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.582996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:33.583617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.583617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:33.697683 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:33.698509 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:33.699326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:33.699646 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:33.699829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.700805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:33.700805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.700805 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:33.700805 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.700805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.700805 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:33.700805 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.700805 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.703014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:33.704354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:38.290441 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:38.292267 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:38.336758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:38.337080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.338116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:38.338116 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.338116 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:38.338116 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.338116 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.338116 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:38.338116 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.338116 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.339176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.340191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:38.463496 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:38.464969 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:38.465734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:38.465734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:38.466685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.466685 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:38.466685 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.466685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.466685 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:38.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.466685 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.468117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.469051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:38.494374 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:38.495240 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:38.495859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:38.496315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.497270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:38.497270 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.497270 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:38.497270 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.497270 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.497270 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:38.497270 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.497270 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:38.498682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.499524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:38.500439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.501210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.502085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:38.502085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.502085 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:38.579109 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:38.579346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:38.580025 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:38.580323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.581046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:38.581046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.581046 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:38.581046 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.581046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.581046 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:38.581046 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.581046 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:38.582501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.583533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:38.584494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.585410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:38.586236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.586236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:38.698432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:38.699049 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:38.699674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:38.700114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:38.700352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.701162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:38.701162 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.701162 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:38.701162 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.701162 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.701162 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:38.701162 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.701162 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.702534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:38.703502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:43.291240 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:43.293302 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:43.295443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:32:43.329152 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:43.329602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.330638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:43.330638 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.330638 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:43.330638 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.330638 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.330638 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:43.330638 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.330638 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.331670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.332386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:43.464267 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:43.465293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:43.465697 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:43.466160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.466979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:43.466979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.466979 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:43.466979 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.466979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.466979 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:43.466979 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.466979 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.468029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.468704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:43.494954 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:43.495592 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:43.496177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:43.496564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.497277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:43.497277 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.497277 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:43.497277 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.497277 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.497277 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:43.497277 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.497277 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:43.498096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:43.498963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.499423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.499982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:43.579987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:43.580678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:43.581816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:43.582300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.583324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:32:43.583324 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.583324 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:43.583324 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.583324 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.583324 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:43.583324 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.583324 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:43.585140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.586053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:43.586550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.587400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:43.588464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.588464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:43.699247 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:43.699851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:43.700435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:43.700723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:43.700903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.701582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:43.701582 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.701582 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:43.701582 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.701582 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.701582 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:43.701582 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.701582 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.702788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:43.703573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:48.292295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:48.294482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:48.347111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:48.347386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.348247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:48.348247 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.348247 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:48.348247 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.348247 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.348247 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:48.348247 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.348247 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.349672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.350519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:48.464712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:48.466076 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:48.466409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:48.466565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.467377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:48.467377 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.467377 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:48.467377 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.467377 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.467377 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:48.467377 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.467377 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.469153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.469755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:48.495716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:48.497232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:48.498086 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:48.498411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.499398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:48.499398 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.499398 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:48.499398 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.499398 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.499398 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:48.499398 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.499398 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:48.500394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.501414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:48.503329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.504164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.505013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:48.505013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.505013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:48.613336 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:48.613991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:48.614460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:48.614763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.615267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:48.615267 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.615267 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:48.615267 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.615267 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.615267 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:48.615267 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.615267 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:48.616089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:48.616426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:48.616426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.616426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:48.616426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.616426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.616426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:48.616426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.616426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:48.616856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.617214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:48.617591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.617591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:48.700188 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:48.700596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:48.701198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:48.701636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:48.701889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.702940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:48.702940 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.702940 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:48.702940 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.702940 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.702940 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:48.702940 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.702940 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.704580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:48.705419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:53.293062 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:53.295084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:53.337478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:53.337655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:53.338552 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.338552 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:53.338552 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.338552 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.338552 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:53.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.338552 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.339432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.340390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:53.465454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:53.466832 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:53.467149 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:53.467322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.468043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:53.468043 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.468043 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:53.468043 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.468043 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.468043 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:53.468043 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.468043 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.469814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.470324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:53.497169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:53.498151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:53.498686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:53.498862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.499529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:53.499529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.499529 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:53.499529 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.499529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.499529 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:53.499529 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.499529 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:53.501500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.502286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:53.503232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.504030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.505148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:53.505148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.505148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:53.613833 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:53.614423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:53.615107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:53.615517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.616318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:53.616318 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.616318 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:53.616318 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.616318 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.616318 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:53.616318 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.616318 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:53.617989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:53.618640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:53.618640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.618640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:53.618640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.618640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.618640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:53.618640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.618640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:53.633137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.633682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:53.634474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.634474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:53.700770 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:53.701828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:53.702352 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:53.702625 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:53.702777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.704243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:53.704243 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.704243 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:53.704243 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.704243 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.704243 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:53.704243 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.704243 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.706429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:53.707292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:58.293916 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:58.295208 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:58.331531 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:58.331793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.332559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:32:58.332559 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.332559 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:58.332559 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.332559 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.332559 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:58.332559 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.332559 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.333837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.335098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:58.466246 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:58.467844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:58.468150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:58.468278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.469892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:58.469892 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.469892 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:58.469892 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.469892 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.469892 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:58.469892 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.469892 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.472094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.472914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:58.497828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:58.498842 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:32:58.499400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:58.499614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.500349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:32:58.500349 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.500349 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:58.500349 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.500349 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.500349 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:58.500349 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.500349 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:58.501389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.502013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:32:58.502521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.503166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.503983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:58.503983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.503983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:58.615038 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:58.615466 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:58.615906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:58.616186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.616718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:58.616718 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.616718 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:58.616718 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.616718 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.616718 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:58.616718 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.616718 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:32:58.617472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:58.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:32:58.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:32:58.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:32:58.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:32:58.618531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.619029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:58.619533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.619533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:32:58.701793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:32:58.702673 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:32:58.703585 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:58.704015 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:32:58.704260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.705225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:32:58.705225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.705225 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:32:58.705225 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.705225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.705225 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:32:58.705225 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.705225 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.707175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:32:58.708371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:03.294793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:03.296770 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:03.336705 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:03.337079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.337797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:33:03.337797 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.337797 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:03.337797 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.337797 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.337797 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:03.337797 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.337797 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.338848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.340140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:03.467008 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:03.468431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:03.468632 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:03.468773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.469375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:03.469375 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.469375 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:03.469375 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.469375 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.469375 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:03.469375 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.469375 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.470716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.471604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:03.499068 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:03.499787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:03.500666 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:03.501011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.501851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:33:03.501851 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.501851 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:03.501851 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.501851 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.501851 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:03.501851 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.501851 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:03.503267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.504253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:03.504894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.505704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.506637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:03.506637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.506637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:03.615565 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:03.616258 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:03.617007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:03.617364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:03.618036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.618036 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:03.618036 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.618036 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.618036 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:03.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.618036 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:03.618965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:03.619489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:03.619489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.619489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:03.619489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.619489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.619489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:03.619489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.619489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:03.620000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.620547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:03.621158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.621158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:03.702619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:03.703266 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:03.703855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:03.704308 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:03.704550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.705453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:03.705453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.705453 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:03.705453 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.705453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.705453 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:03.705453 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.705453 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.707179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:03.707990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:08.295719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:08.297286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:08.333650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:08.333816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.334228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:33:08.334228 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.334228 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:08.334228 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.334228 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.334228 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:08.334228 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.334228 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.335014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.335622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:08.467701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:08.468828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:08.469140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:08.469376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.470158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:08.470158 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.470158 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:08.470158 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.470158 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.470158 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:08.470158 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.470158 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.471523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.472825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:08.499560 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:08.500327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:08.501120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:08.501392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.502315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:33:08.502315 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.502315 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:08.502315 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.502315 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.502315 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:08.502315 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.502315 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:08.503853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.504534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:08.506212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.506842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.507734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:08.507734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.507734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:08.616453 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:08.617224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:08.618517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:08.618980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.619920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:08.619920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.619920 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:08.619920 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.619920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.619920 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:08.619920 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.619920 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:08.621310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:08.622330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:08.622330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.622330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:08.622330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.622330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.622330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:08.622330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.622330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:08.623065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.624000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:08.625039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.625039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:08.703483 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:08.704462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:08.705241 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:08.706304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:08.706304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.706798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:08.706798 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.706798 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:08.706798 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.706798 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.706798 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:08.706798 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.706798 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.709938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:08.710926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:13.296454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:13.298107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:13.336629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:13.337173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.338239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:33:13.338239 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.338239 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:13.338239 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.338239 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.338239 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:13.338239 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.338239 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.339530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.340168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:13.468530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:13.469872 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:13.470177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:13.470486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.471706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:13.471706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.471706 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:13.471706 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.471706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.471706 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:13.471706 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.471706 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.473681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.474719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:13.500184 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:13.501341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:13.502200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:13.502485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.503388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:33:13.503388 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.503388 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:13.503388 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.503388 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.503388 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:13.503388 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.503388 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:13.505057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.505804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:13.506429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.506955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.507480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:13.507480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.507480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:13.617408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:13.618366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:13.619659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:13.620059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.621060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:13.621060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.621060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:13.621060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.621060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.621060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:13.621060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.621060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:13.622566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:13.623388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:13.623388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.623388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:13.623388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.623388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.623388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:13.623388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.623388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:13.624423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.625247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:13.626144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.626144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:13.704372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:13.704870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:13.705675 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:13.706009 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:13.706174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.707097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:13.707097 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.707097 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:13.707097 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.707097 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.707097 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:13.707097 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.707097 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.708791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:13.709606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:18.297278 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:18.299386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:18.346423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:18.346761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.347661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:33:18.347661 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.347661 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:18.347661 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.347661 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.347661 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:18.347661 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.347661 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.348682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.349250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:18.469455 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:18.471154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:18.471485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:18.471725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.472573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:18.472573 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.472573 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:18.472573 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.472573 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.472573 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:18.472573 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.472573 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.474206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.475129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:18.500808 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:18.501841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:18.502689 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:18.503137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.504091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:33:18.504091 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.504091 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:18.504091 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.504091 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.504091 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:18.504091 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.504091 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:18.505604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.506360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:18.507321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.508095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.508903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:18.508903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.508903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:18.618080 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:18.618733 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:18.619376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:18.619685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.620316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:18.620316 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.620316 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:18.620316 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.620316 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.620316 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:18.620316 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.620316 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:18.621120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:18.621470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:18.621470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.621470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:18.621470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.621470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.621470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:18.621470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.621470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:18.621922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.622269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:18.622675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.622675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:18.705221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:18.706000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:18.706708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:18.707226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:18.707690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.708455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:18.708455 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.708455 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:18.708455 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.708455 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.708455 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:18.708455 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.708455 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.710212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:18.711425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:23.298326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:23.300064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:23.335367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:23.335559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.336448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:33:23.336448 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.336448 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:23.336448 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.336448 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.336448 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:23.336448 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.336448 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.337908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.338453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:23.470258 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:23.471898 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:23.472331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:23.472625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.473717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:23.473717 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.473717 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:23.473717 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.473717 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.473717 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:23.473717 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.473717 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.475557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.476444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:23.501753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:23.502359 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:23.503058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:23.503421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.504677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:23.504677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.504677 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:23.504677 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.504677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.504677 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:23.504677 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.504677 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:23.505263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.506044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:23.506756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.507561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:23.618812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:23.619222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:23.620079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:23.620507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.621573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:33:23.621573 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.621573 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:23.621573 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.621573 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.621573 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:23.621573 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.621573 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:23.623023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.623461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:23.625086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.625562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:23.626059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.626059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:23.705904 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:23.706565 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:23.707375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:23.707769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:23.708084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.708969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:23.708969 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.708969 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:23.708969 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.708969 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.708969 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:23.708969 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.708969 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.710590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:23.711404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:28.299048 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:28.300390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:28.715712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:28.715712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:28.716179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:28.716179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:28.717174 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:28.718200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:28.727853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:28.728255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:28.728533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:28.728731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.730030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:28.730030 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.730030 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:28.730030 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.730030 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.730030 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:28.730030 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.730030 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.735051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.735773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:28.736559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:28.736559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.738657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:28.738657 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.738657 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:28.738657 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.738657 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.738657 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:28.738657 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.738657 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:28.740797 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:28.744148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:28.745011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:28.750213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.751247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:28.752470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:28.753496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:28.754016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:28.754016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.754016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:28.754016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.754016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.754016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:28.754016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.754016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:28.755274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:28.759566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.760636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:28.761626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.761626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:28.761626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.762289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:28.762289 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.762289 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:28.762289 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.762289 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.762289 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:28.762289 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.762289 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.764708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.765406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Traceback (most recent call last):
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-d5a44571-566f-4985-8392-fd4a04e635cc None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:28.803725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:28.804626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:28.805502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:33.299758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:33.300780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:33.343844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:33.344512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.345581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:33:33.345581 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.345581 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:33.345581 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.345581 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.345581 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:33.345581 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.345581 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.346558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.347189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:33.716952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:33.718423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:33.719270 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:33.719406 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:33.720043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:33.721736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:33.722185 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:33.722639 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:33.723220 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:33.723397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.724527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:33:33.724527 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.724527 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:33.724527 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.724527 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.724527 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:33.724527 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.724527 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:33.726832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.727730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:33.728752 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:33.728752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.729147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:33.729147 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.729147 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:33.729147 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.729147 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.729147 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:33.729147 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.729147 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:33.730351 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:33.731888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:33.732445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:33.733530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.734189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.734654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:33.734654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.734654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:33.734654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:33.734654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:33.734654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.735242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:33.735242 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.735242 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:33.735242 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.735242 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.735242 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:33.735242 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.735242 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.737078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:33.737822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Traceback (most recent call last):
Mar 19 18:33:33.738470 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.738470 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:33.738470 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.738470 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.738470 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:33.738470 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.738470 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:33.739740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.740391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-95308b10-0eff-459a-a13e-aba840a941f6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:33.741690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:33.742216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:33.742703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:33.742703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:38.300689 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:38.303137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:38.344192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:38.344444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.345464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:33:38.345464 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.345464 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:38.345464 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.345464 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.345464 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:38.345464 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.345464 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.346533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.347299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:38.718474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:38.720089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:38.720498 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:38.721011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:38.721116 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:38.722021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:38.723617 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:38.724455 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:38.724767 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:38.724867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.726218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:33:38.726218 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.726218 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:38.726218 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.726218 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.726218 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:38.726218 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.726218 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:38.726900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:38.729242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.731272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:38.732028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.732574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:38.733094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.733587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.734119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:38.734119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.734119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:38.734119 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:38.734119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.735042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:33:38.735042 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.735042 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:38.735042 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.735042 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.735042 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:38.735042 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.735042 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:38.736974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:38.737518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:38.739323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.739796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:38.740366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.740366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:38.740366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:38.740366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.740855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:38.740855 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.740855 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:38.740855 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.740855 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.740855 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:38.740855 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.740855 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.742541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:38.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:43.301571 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:43.303133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:43.304818 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:33:43.351782 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:43.352059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.352692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:33:43.352692 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.352692 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:43.352692 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.352692 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.352692 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:43.352692 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.352692 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.353692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.354555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:43.719850 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:43.721721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:43.722042 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:43.722686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:43.723493 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:43.724043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:43.724533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:43.725362 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:43.725362 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:43.725651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.726956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:33:43.726956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.726956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:43.726956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.726956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.726956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:43.726956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.726956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:43.729106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.729965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:43.730980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:43.730980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.731101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:33:43.731101 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.731101 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:43.731101 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.731101 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.731101 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:43.731101 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.731101 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:43.732379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:43.733348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:43.734212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.735075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.735924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:43.735924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.735924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:43.735924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.735924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:43.735924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:43.735924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.736559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:33:43.736559 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.736559 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:43.736559 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.736559 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.736559 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:43.736559 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.736559 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:43.737691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:33:43.737691 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.737691 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:43.737691 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.737691 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.737691 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:43.737691 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.737691 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:43.739338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.739872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.741763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.742523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:43.743541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:43.744183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:43.744656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:43.744656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:48.302214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:48.304149 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:48.340184 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:48.341065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.342138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:33:48.342138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.342138 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:48.342138 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.342138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.342138 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:48.342138 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.342138 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.343171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.344017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:48.720949 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:48.722840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:48.724180 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:48.724600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:48.725229 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:48.725786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:48.726239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.727421 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:48.727994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:48.728732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:48.729087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:48.729087 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.729087 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:48.729087 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.729087 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.729087 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:48.729087 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.729087 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:48.729546 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:48.729740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.731866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.732641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:48.733167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:48.735464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:48.735937 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:48.736251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:33:48.736251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.736251 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:48.736251 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.736251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.736251 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:48.736251 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.736251 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:48.738282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.738796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.739376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:48.739376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.739376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:48.739376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:48.739637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:48.740144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:48.742415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.743338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Traceback (most recent call last):
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.743920 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e17380ce-7402-4b93-a23f-f085f1ace25f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.745894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:48.746448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:53.302806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:53.304050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:53.346182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:53.346748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.348077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:33:53.348077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.348077 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:53.348077 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.348077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.348077 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:53.348077 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.348077 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.349130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.349947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:53.721924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:53.723488 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:53.723947 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:53.724213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.725235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:53.725744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:53.725744 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.725744 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:53.725744 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.725744 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.725744 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:53.725744 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.725744 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.728230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.729130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:53.729957 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:53.729957 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:53.729957 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:53.730177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:53.730843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:53.731394 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:53.731745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.733316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:33:53.733316 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.733316 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:53.733316 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.733316 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.733316 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:53.733316 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.733316 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:53.734617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:53.735115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:53.736478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.736973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.737440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:53.737440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.737440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:53.737440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:53.737440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.737925 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:53.738430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:53.738430 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.738430 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:53.738430 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.738430 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.738430 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:53.738430 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.738430 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:53.738764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.740896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:53.741367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:33:53.741867 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.741867 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:53.741867 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.741867 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.741867 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:53.741867 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.741867 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:53.742142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.742551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:53.743291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:53.743743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:53.744264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:53.744264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:58.303922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:58.305682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:58.345986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:58.346282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.347394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:33:58.347394 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.347394 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:58.347394 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.347394 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.347394 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:58.347394 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.347394 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.348394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.349281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:58.722870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:58.724834 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:58.725300 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:58.725568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.726782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:33:58.726782 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.726782 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:58.726782 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.726782 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.726782 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:58.726782 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.726782 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:58.729509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.730349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:58.731398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:58.731398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:58.731398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:33:58.731398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:33:58.732134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:58.732847 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:33:58.733136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:58.733601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.734711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:33:58.734711 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.734711 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:58.734711 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.734711 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.734711 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:58.734711 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.734711 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:58.735858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:58.736762 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:33:58.737446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.738186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:58.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:58.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:58.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:33:58.739271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.739708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:33:58.739708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.739708 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:58.739708 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.739708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.739708 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:58.739708 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.739708 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:33:58.741256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.741688 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:33:58.743459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.744022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:58.744527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.744527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.745079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:33:58.745572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:03.305018 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:03.306945 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:03.348371 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:03.348637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.349222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:03.349222 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.349222 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:03.349222 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.349222 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.349222 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:03.349222 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.349222 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.350030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.350769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:03.724227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:03.726304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:03.726752 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:03.727112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.728405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:34:03.728405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.728405 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:03.728405 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.728405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.728405 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:03.728405 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.728405 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:03.730208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.732064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:03.733162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:03.733162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:03.733162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:03.733162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:03.733162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:03.733505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:03.734011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:03.734262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.735056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:34:03.735056 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.735056 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:03.735056 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.735056 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.735056 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:03.735056 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.735056 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:03.736057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.736977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:03.737734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.738537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.739444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:03.739444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.739444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:03.739444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:03.739444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.740311 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:03.741038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:03.741038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.741038 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:03.741038 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.741038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.741038 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:03.741038 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.741038 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:03.741467 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:03.741598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:03.743563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:03.744033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:03.744033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.744033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:03.744033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.744033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.744033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:03.744033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.744033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:03.745311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.745828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.746662 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.747999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:03.748665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:08.306038 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:08.308323 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:08.348404 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:08.348768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.349629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:08.349629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.349629 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:08.349629 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.349629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.349629 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:08.349629 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.349629 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.350745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.351705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:08.725404 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:08.727146 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:08.727560 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:08.727820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.729200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:34:08.729200 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.729200 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:08.729200 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.729200 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.729200 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:08.729200 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.729200 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:08.731234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.732181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:08.733202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:08.733202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:08.733397 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:08.733656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:08.734354 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:08.735046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:08.735308 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:08.735693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.736163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:34:08.736163 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.736163 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:08.736163 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.736163 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.736163 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:08.736163 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.736163 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:08.737499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:08.738437 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:08.739440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.740363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.741538 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:08.742152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:08.743003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:08.743434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.744233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.745344 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.746597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:08.747163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:13.306761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:13.308926 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:13.342086 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:13.342599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.343859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:13.343859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.343859 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:13.343859 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.343859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.343859 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:13.343859 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.343859 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.346584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.347610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:13.726386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:13.728040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:13.728447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:13.728730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.730186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:13.730186 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.730186 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:13.730186 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.730186 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.730186 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:13.730186 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.730186 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.732469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.733476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.734304 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:13.735291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:13.736147 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:13.736768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.737274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.737761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:13.737761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.737761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:13.737761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:13.737761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:13.738120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:13.738372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:13.738617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.739378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:34:13.739378 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.739378 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:13.739378 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.739378 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.739378 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:13.739378 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.739378 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:13.740396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:13.740837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:13.742086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.742560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:13.743137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.743137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:13.743137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:13.743137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.743529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:13.743529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.743529 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:13.743529 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.743529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.743529 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:13.743529 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.743529 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.744785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:13.745258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:18.307831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:18.309678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:18.351623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:18.352105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.353183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:18.353183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.353183 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:18.353183 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.353183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.353183 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:18.353183 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.353183 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.354568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.355399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:18.727296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:18.730037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:18.730348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:18.730515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.731605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:34:18.731605 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.731605 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:18.731605 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.731605 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.731605 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:18.731605 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.731605 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:18.733929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.734947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:18.736000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:18.736000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:18.736000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:18.736000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.736715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:18.737005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:18.737005 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.737005 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:18.737005 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.737005 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.737005 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:18.737005 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.737005 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:18.738220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:18.739558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:18.740399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.741295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.741821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:18.741821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.741821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:18.741821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:18.741821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:18.742322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:18.742857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.743791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:18.744451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Traceback (most recent call last):
Mar 19 18:34:18.744451 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.744451 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:18.744451 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.744451 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.744451 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:18.744451 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.744451 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:18.745255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:18.746664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:18.747158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-effe0792-6edb-4087-8713-1a9a241c72d1 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:18.749176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.749684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.750272 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.750947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:18.751635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:23.308864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:23.310293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:23.346394 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:23.347501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.348007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:23.348007 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.348007 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:23.348007 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.348007 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.348007 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:23.348007 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.348007 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.349062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.349667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:23.728324 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:23.730497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:23.730906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:23.731169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.732536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:34:23.732536 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.732536 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:23.732536 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.732536 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.732536 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:23.732536 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.732536 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:23.734756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.735537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:23.736347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:23.736347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:23.736707 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:23.736966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.737571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:34:23.737571 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.737571 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:23.737571 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.737571 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.737571 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:23.737571 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.737571 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:23.739086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.739541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:23.739819 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:23.741307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.741802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.742369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:23.742369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.742369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:23.742369 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:23.742369 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:23.742369 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:23.742794 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:23.743100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.743746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:23.743988 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:23.744144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.744708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Traceback (most recent call last):
Mar 19 18:34:23.744708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.744708 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:23.744708 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.744708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.744708 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:23.744708 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.744708 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9391ab18-96ef-4bfb-9b80-9c36b580b84c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.745757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:23.746302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:23.746815 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.746815 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:23.746815 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.746815 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.746815 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:23.746815 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.746815 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:23.747848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:23.748345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:23.748345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.748345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:23.748345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.748345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.748345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:23.748345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.748345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:23.749409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:23.750002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:23.750550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:23.750550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:28.309630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:28.312151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:28.349448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:28.349730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.351010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:28.351010 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.351010 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:28.351010 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.351010 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.351010 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:28.351010 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.351010 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.352117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.353454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:28.729460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:28.730902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:28.731205 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:28.731446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.732374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:34:28.732374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.732374 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:28.732374 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.732374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.732374 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:28.732374 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.732374 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:28.733466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.734082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:28.735996 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:28.737366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:28.738210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:28.738529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.739623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:28.739623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.739623 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:28.739623 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.739623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.739623 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:28.739623 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.739623 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:28.740448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:28.741201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:28.741201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.741201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:28.741201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.741201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.741201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:28.741201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.741201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:28.741671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.742219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.742794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:28.742794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.742794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:28.742794 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:28.742794 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:28.743027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:28.744051 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:28.744536 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:28.744823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.745468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:28.745468 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.745468 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:28.745468 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.745468 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.745468 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:28.745468 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.745468 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:28.747255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:28.748258 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:28.749738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.750533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.751283 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.753039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:28.754072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:33.310779 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:33.313034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:33.347129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:33.347504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.348411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:33.348411 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.348411 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:33.348411 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.348411 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.348411 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:33.348411 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.348411 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.349664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.351254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:33.730611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:33.732238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:33.732791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:33.733169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.734557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:34:33.734557 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.734557 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:33.734557 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.734557 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.734557 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:33.734557 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.734557 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:33.736534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.737322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:33.738140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:33.738140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:33.738140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:33.738337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:33.738980 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.738980 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:33.738980 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.738980 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.738980 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:33.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.738980 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:33.740201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:33.740769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:33.740769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.740769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:33.740769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.740769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.740769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:33.740769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.740769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:33.741676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.742200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.742754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:33.742754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.742754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:33.742754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:33.743141 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:33.743464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:33.743955 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:33.744544 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:33.745000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.745835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:33.746418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:33.746807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:33.746807 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.746807 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:33.746807 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.746807 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.746807 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:33.746807 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.746807 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:33.747352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:33.749241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:33.749699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:33.749699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.749699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:33.749699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.749699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.749699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:33.749699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.749699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:33.750940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.751401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.752024 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.752311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:33.752819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:37.988559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:38.000379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:389}}
Mar 19 18:34:38.000674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=103900) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:370}}
Mar 19 18:34:38.000791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Fixing resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:34:38.040656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, resource={'id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'name': 'private', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb', 'bee598c2-f62b-4321-b08d-23e3a7c6ccb9'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:09:27Z', 'updated_at': '2026-03-19T18:09:31Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 29513}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.040982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.041092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b55270e8-5359-4f54-8804-fcbd7769eee3, external_ids_update=None, columns={'tag': 29513}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.041236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.041899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Traceback (most recent call last):
Mar 19 18:34:38.041899 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.041899 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.041899 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.041899 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.041899 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.041899 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.041899 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Failed to fix resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.043133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.043578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.044171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:34:38.044171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.044171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:34:38.044171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Fixing resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:34:38.105774 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, resource={'id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'name': 'public', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['7888df47-ce34-4091-9e08-c1c5949f53a2', 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-03-19T18:09:34Z', 'updated_at': '2026-03-19T18:09:44Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.106117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.106486 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-20b6196a-9254-4b37-a645-8253845242a7, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.106729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.107386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Traceback (most recent call last):
Mar 19 18:34:38.107386 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.107386 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.107386 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.107386 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.107386 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.107386 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.107386 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Failed to fix resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.108590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.108977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.109355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:34:38.109355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.109355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:34:38.109355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Fixing resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:34:38.137157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-420e2995-aa57-46db-9651-85807f50bcb9, resource={'id': '420e2995-aa57-46db-9651-85807f50bcb9', 'name': 'admin_net', 'tenant_id': '1ed140779dbc462d89fd3e785886b2bb', 'project_id': '1ed140779dbc462d89fd3e785886b2bb', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['388b450f-f17e-4671-94e9-9f169d754be7'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:13:33Z', 'updated_at': '2026-03-19T18:13:34Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 28229}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.137579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-420e2995-aa57-46db-9651-85807f50bcb9, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.137670 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-07b4049d-60f0-4621-a8e7-5dcac93308be, external_ids_update=None, columns={'tag': 28229}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.137840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.138540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Traceback (most recent call last):
Mar 19 18:34:38.138540 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.138540 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.138540 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.138540 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.138540 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.138540 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.138540 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Failed to fix resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.140768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.141650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:34:38.141650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.141650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:34:38.141650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Fixing resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:34:38.171561 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, resource={'id': '4d64a793-ee68-4a18-b938-f55304c6fcf6', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0bc68cc0-48dc-4abe-bbac-0a4f654efb2e'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:14:20Z', 'updated_at': '2026-03-19T18:14:21Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 59295}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.172155 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.172856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-42ff4b0a-bf0a-4937-bf0f-c8b42f68f267, external_ids_update=None, columns={'tag': 59295}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.173020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.173739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Traceback (most recent call last):
Mar 19 18:34:38.173739 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.173739 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.173739 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.173739 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.173739 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.173739 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.173739 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Failed to fix resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.174928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.176108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.176797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:34:38.176797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.176797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:34:38.176797 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Fixing resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:34:38.257834 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, resource={'id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'enable_snat': True}, 'gw_port_id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-1id6n', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'ip_address': '172.24.5.52', 'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, {'ip_address': '2001:db8::2c3', 'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:25Z', 'revision_number': 3, 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89'}, resource_type=routers, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.258232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.258697 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.259026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.259287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.260282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Traceback (most recent call last):
Mar 19 18:34:38.260282 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.260282 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.260282 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.260282 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.260282 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.260282 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.260282 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.260721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Unable to update router cf5e0251-94c8-4bce-b873-648b8cc72809. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Failed to fix resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Mar 19 18:34:38.262148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:34:38.262751 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:34:38.263639 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Fixing resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:34:38.316790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:38.322535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:38.414208 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.414527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.415700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:38.415700 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.415700 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.415700 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.415700 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.415700 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.415700 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.415700 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.420535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.421300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:38.444937 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, resource={'id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'name': '', 'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'project_id': '', 'mac_address': 'fa:16:3e:11:31:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000160124', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:24Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.445351 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::2c3/64', '172.24.5.52/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.446599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=f319bf7e-5d34-47af-b620-bec8597c3819, lrouter_port=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.446599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.449372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Traceback (most recent call last):
Mar 19 18:34:38.449372 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.449372 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.449372 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.449372 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.449372 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.449372 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.449372 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Failed to fix resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.449969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.450490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.451415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:34:38.451415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.451415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:34:38.451415 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-d6b4e0fd-74fa-4241-856a-8683924d1aa0 None None] Maintenance task: Synchronization completed (took 0.45 seconds)
Mar 19 18:34:38.731318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:38.733389 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.733799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.734117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.735048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:38.735048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.735048 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.735048 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.735048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.735048 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.735048 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.735048 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.736309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.736787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:38.737225 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:38.737870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:38.738497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.738801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.739579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:34:38.739579 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.739579 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.739579 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.739579 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.739579 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.739579 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.739579 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:38.740952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.741319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:38.742251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.742580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.742956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:38.742956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.742956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:38.743206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:38.743835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:38.744297 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:38.744693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.744958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.745973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:38.746543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:38.746543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.746543 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.746543 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.746543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.746543 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.746543 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.746543 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:38.747231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.747665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:38.747665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.747665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:38.747665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.747665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.747665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:38.747665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.747665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:38.747986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:38.750000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.750517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:38.751007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.751007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:38.751007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:38.751007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.751444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:38.751444 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.751444 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:38.751444 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.751444 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.751444 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:38.751444 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.751444 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.752795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:38.753287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:43.318407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:43.319644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:43.321318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=434 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:34:43.351798 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:43.352617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.353524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:43.353524 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.353524 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:43.353524 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.353524 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.353524 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:43.353524 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.353524 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.354500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.355052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:43.733291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:43.735076 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:43.735385 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:43.735643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.736708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:43.736708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.736708 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:43.736708 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.736708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.736708 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:43.736708 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.736708 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.738828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.739732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:43.740611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:43.740611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:43.741106 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:43.741106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.742065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:34:43.742065 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.742065 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:43.742065 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.742065 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.742065 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:43.742065 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.742065 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:43.743664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.744828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:43.745799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.746809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:43.748269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:43.748933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:43.749543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.750305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:43.750523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:43.750667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.751261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:43.751261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.751261 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:43.751261 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.751261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.751261 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:43.751261 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.751261 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.752769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:43.753482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:43.754077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.754632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:43.755155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:43.755743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:43.756305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:43.756305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:48.319205 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:48.320747 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:48.354113 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:48.354479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.355301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:48.355301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.355301 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:48.355301 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.355301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.355301 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:48.355301 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.355301 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.356278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.357231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:48.734153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:48.735870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:48.736347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:48.736604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.737778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:48.737778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.737778 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:48.737778 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.737778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.737778 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:48.737778 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.737778 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.740150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.741222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:48.742203 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:48.742203 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:48.742203 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:48.742329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.743023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:48.743023 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.743023 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:48.743023 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.743023 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.743023 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:48.743023 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.743023 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:48.743784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:48.744329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:48.744329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.744329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:48.744329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.744329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.744329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:48.744329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.744329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:48.744896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.745565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.746092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:48.746092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.746092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:48.747413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:48.748206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:48.748753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:48.749233 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:48.749670 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:48.750116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.751041 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:48.751409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:48.751655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.752476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:48.752476 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.752476 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:48.752476 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.752476 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.752476 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:48.752476 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.752476 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:48.752976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:48.752976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.752976 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:48.752976 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.752976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.752976 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:48.752976 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.752976 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:48.754641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:48.755082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:48.755082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.755082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:48.755082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.755082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.755082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:48.755082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.755082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.756118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.756571 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:48.757694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:48.758233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:48.758763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:48.758763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:53.320144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:53.322286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:53.353328 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:53.353590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.354263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:53.354263 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.354263 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:53.354263 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.354263 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.354263 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:53.354263 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.354263 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.355214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.355960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:53.734989 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:53.737184 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:53.737541 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:53.737768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.738950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:53.738950 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.738950 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:53.738950 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.738950 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.738950 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:53.738950 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.738950 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.741061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.741609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:53.742128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:53.742128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:53.742854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:53.743164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.743949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:34:53.743949 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.743949 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:53.743949 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.743949 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.743949 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:53.743949 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.743949 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:53.745186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.745620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:53.746291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.746748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.747348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:53.747348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.747348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:53.748045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:53.748895 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:53.749512 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:53.749772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.750468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:53.751185 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:53.751678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:53.751678 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.751678 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:53.751678 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.751678 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.751678 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:53.751678 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.751678 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:53.754323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:53.754796 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:53.756025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.756485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:53.756999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.756999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:53.756999 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:53.756999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.757374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:53.757374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.757374 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:53.757374 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.757374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.757374 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:53.757374 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.757374 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.759307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:53.760147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:58.321696 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:58.323376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:58.362717 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:58.363210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.363464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:34:58.363464 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.363464 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:58.363464 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.363464 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.363464 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:58.363464 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.363464 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.364295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.365301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:58.736450 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:58.737898 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:58.738405 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:58.738531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.739384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:58.739384 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.739384 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:58.739384 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.739384 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.739384 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:58.739384 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.739384 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.741264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.743518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:58.744587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:58.744587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:34:58.744587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:58.744587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.745139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:34:58.745139 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.745139 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:58.745139 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.745139 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.745139 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:58.745139 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.745139 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:58.745896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.746393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:34:58.746986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.747583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.748157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:58.748157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.748157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:58.748685 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:58.749163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:58.749614 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:58.750014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.750647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:58.750647 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.750647 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:58.750647 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.750647 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.750647 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:58.750647 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.750647 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:34:58.751645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:34:58.752300 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:34:58.753491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.754135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:58.754855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.754855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:34:58.754855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:34:58.754855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:58.754855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:34:58.754855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.755158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:34:58.755158 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.755158 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:34:58.755158 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.755158 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.755158 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:34:58.755158 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.755158 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.756019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:34:58.756778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:03.322393 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:03.324012 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:03.362718 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:03.362977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.363975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:03.363975 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.363975 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:03.363975 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.363975 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.363975 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:03.363975 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.363975 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.364975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.365901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:03.737292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:03.739018 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:03.739401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:03.739697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.741253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:03.741253 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.741253 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:03.741253 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.741253 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.741253 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:03.741253 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.741253 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.743305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.744251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.746129 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:03.746736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.747576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:03.748449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:03.749133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:03.749728 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:03.750421 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:03.750624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.751405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:03.751405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.751405 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:03.751405 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.751405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.751405 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:03.751405 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.751405 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:03.752279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:03.753048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:03.753048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.753048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:03.753048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.753048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.753048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:03.753048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.753048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:03.753394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.754221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:03.755071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.755071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:03.755071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:03.755071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:03.755071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:03.755071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:03.755071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.756211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:03.756211 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.756211 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:03.756211 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.756211 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.756211 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:03.756211 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.756211 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.756578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:03.757952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:08.323790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:08.325718 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:08.367243 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:08.367703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.368859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:08.368859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.368859 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:08.368859 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.368859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.368859 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:08.368859 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.368859 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.370208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.371216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:08.738158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:08.740068 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:08.740460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:08.740799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.741928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:08.741928 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.741928 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:08.741928 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.741928 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.741928 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:08.741928 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.741928 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.743395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.744343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:08.745238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:08.745238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:08.745395 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:08.745595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.746292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:08.746292 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.746292 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:08.746292 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.746292 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.746292 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:08.746292 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.746292 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:08.747792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.748703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:08.749450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.750218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.751402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:08.751402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.751402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:08.751402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:08.751402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:08.751402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:08.751747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.752129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:08.752129 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.752129 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:08.752129 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.752129 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.752129 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:08.752129 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.752129 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:08.753621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:08.754229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:08.754229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.754229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:08.754229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.754229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.754229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:08.754229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.754229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:08.755744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.756325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:08.757032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.757032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:08.757032 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:08.757032 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:08.757204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:08.757444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:08.757616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.758256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:08.758256 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.758256 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:08.758256 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.758256 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.758256 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:08.758256 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.758256 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.760416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:08.761037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:13.326027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:13.327342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:13.369248 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:13.369605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.370501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:13.370501 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.370501 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:13.370501 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.370501 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.370501 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:13.370501 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.370501 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.371897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.372579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:13.739108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:13.740227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:13.740841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:13.740841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.742041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:13.742041 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.742041 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:13.742041 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.742041 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.742041 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:13.742041 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.742041 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.743913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.744981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:13.745748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:13.745748 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:13.746102 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:13.746356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.747146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:13.747146 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.747146 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:13.747146 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.747146 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.747146 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:13.747146 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.747146 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:13.749057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.749518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:13.750869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.751644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.752213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:13.752213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.752213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:13.752213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:13.752213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:13.752392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:13.752618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.753217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:13.753217 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.753217 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:13.753217 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.753217 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.753217 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:13.753217 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.753217 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:13.754341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:13.754815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:13.754815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.754815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:13.754815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.754815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.754815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:13.754815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.754815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:13.755621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.756126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:13.756656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.756656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:13.756656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:13.756862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:13.757183 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:13.757429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:13.757617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.758174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:13.758174 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.758174 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:13.758174 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.758174 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.758174 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:13.758174 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.758174 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:13.759785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:18.325416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:18.327197 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:18.363928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:18.364396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.365515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:18.365515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.365515 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:18.365515 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.365515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.365515 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:18.365515 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.365515 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.366897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.368011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:18.739951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:18.741988 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:18.742376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:18.742648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.743629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:18.743629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.743629 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:18.743629 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.743629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.743629 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:18.743629 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.743629 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.744706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.745546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:18.746535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:18.746535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:18.746535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:18.746743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.747373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:18.747373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.747373 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:18.747373 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.747373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.747373 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:18.747373 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.747373 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:18.748913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.749279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:18.750674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.751084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.751570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:18.751570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.751570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:18.752065 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:18.752694 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:18.753240 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:18.753517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.754199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:18.754199 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.754199 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:18.754199 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.754199 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.754199 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:18.754199 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.754199 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:18.755782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:18.756315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:18.756315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.756315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:18.756315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.756315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.756315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:18.756315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.756315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:18.758078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.759439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:18.760435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.760435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:18.760435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:18.760435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:18.760435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:18.760910 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:18.760910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.761404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:18.761404 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.761404 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:18.761404 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.761404 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.761404 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:18.761404 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.761404 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.763166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:18.764240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:23.326157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:23.328256 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:23.369295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:23.369746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.370813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:23.370813 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.370813 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:23.370813 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.370813 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.370813 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:23.370813 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.370813 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.371775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.372817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:23.741004 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:23.742321 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:23.742761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:23.743040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.744066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:23.744066 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.744066 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:23.744066 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.744066 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.744066 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:23.744066 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.744066 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.745871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.746737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:23.747851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:23.747851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:23.747851 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:23.747851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.748740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:23.748740 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.748740 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:23.748740 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.748740 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.748740 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:23.748740 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.748740 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:23.749997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.750820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:23.751560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.752348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.753047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:23.753047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.753047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:23.753047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:23.753047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:23.753566 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:23.753789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.754326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:23.754326 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.754326 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:23.754326 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.754326 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.754326 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:23.754326 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.754326 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:23.754931 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:23.755401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:23.755401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.755401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:23.755401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.755401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.755401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:23.755401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.755401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:23.755674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.756180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:23.756672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.756672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:23.759336 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:23.759770 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:23.760097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:23.760277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:23.760433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.760893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:23.760893 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.760893 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:23.760893 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.760893 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.760893 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:23.760893 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.760893 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.762247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:23.762742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:28.327017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:28.329396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:28.361658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:28.361938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.362509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:28.362509 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.362509 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:28.362509 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.362509 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.362509 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:28.362509 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.362509 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.363367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.364016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:28.741682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:28.742507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:28.742738 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:28.742868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.743589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:28.743589 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.743589 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:28.743589 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.743589 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.743589 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:28.743589 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.743589 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.744661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.745541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:28.746752 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:28.747423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:28.747902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:28.748076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.749153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:28.749153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.749153 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:28.749153 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.749153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.749153 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:28.749153 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.749153 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:28.750342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.750866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:28.752474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.753389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.754861 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:28.755857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:28.756625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:28.757132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.757683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:28.759685 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:28.760035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:28.760447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:28.760684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:28.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.761415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:28.761415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.761415 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:28.761415 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.761415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.761415 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:28.761415 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.761415 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.762385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:28.762959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:33.327768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:33.328854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:33.365333 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:33.365597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.366411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:33.366411 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.366411 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:33.366411 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.366411 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.366411 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:33.366411 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.366411 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.367448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.368684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:33.742306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:33.743681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:33.744027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:33.744215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.745154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:33.745154 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.745154 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:33.745154 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.745154 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.745154 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:33.745154 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.745154 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.746463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.746937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:33.747329 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:33.747616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:33.747978 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:33.748198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.748749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:33.748749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.748749 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:33.748749 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.748749 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.748749 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:33.748749 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.748749 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:33.749709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.750137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:33.750920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.751736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.752109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:33.752109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.752109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:33.753331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:33.753728 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:33.754372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:33.754656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.755204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:33.755204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.755204 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:33.755204 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.755204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.755204 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:33.755204 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.755204 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:33.756456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:33.756797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:33.756797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.756797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:33.756797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.756797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.756797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:33.756797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.756797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:33.757658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.758234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:33.758569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.758569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:33.760288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:33.761069 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:33.761405 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:33.761634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:33.761795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.762673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:33.762673 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.762673 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:33.762673 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.762673 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.762673 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:33.762673 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.762673 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.763748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:33.764392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:38.328344 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:38.330469 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:38.374719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:38.375212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.376364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:38.376364 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.376364 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:38.376364 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.376364 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.376364 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:38.376364 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.376364 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.377706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.378333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:38.742975 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:38.744624 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:38.745083 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:38.745342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.746653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:38.746653 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.746653 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:38.746653 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.746653 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.746653 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:38.746653 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.746653 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.748590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.749937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:38.750964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:38.750964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:38.750964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:38.750964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.751372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:38.751372 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.751372 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:38.751372 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.751372 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.751372 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:38.751372 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.751372 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:38.752686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.753709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:38.754321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.755252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.756320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:38.756320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.756320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:38.756320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:38.756320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:38.756320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:38.756320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.756897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:38.756897 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.756897 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:38.756897 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.756897 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.756897 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:38.756897 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.756897 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:38.758466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:38.759159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:38.759159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.759159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:38.759159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.759159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.759159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:38.759159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.759159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:38.760236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.760714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:38.761455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.761455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:38.761455 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:38.762072 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:38.762473 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:38.762693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:38.763069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.763494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:38.763494 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.763494 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:38.763494 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.763494 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.763494 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:38.763494 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.763494 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.765262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:38.765773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:43.329267 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:43.331356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:43.333502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:35:43.367915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:43.368381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.369162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:43.369162 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.369162 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:43.369162 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.369162 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.369162 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:43.369162 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.369162 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.370228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.371084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:43.743952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:43.746176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:43.746471 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:43.746604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.747903 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.749864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.750818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:43.751669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:43.751669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:43.751669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:43.751669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.752385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:43.752385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.752385 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:43.752385 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.752385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.752385 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:43.752385 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.752385 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:43.753689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:43.754533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:43.754533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.754533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:43.754533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.754533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.754533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:43.754533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.754533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:43.755520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.756374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.757343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:43.757343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.757343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:43.757343 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:43.757343 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:43.757343 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:43.757682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.758494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:43.758494 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.758494 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:43.758494 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.758494 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.758494 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:43.758494 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.758494 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:43.760043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:43.760573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:43.760573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.760573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:43.760573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.760573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.760573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:43.760573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.760573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:43.761732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.762281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:43.762800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.762800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:43.762800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:43.762925 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:43.763507 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:43.763918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:43.764170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.764958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:43.764958 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.764958 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:43.764958 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.764958 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.764958 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:43.764958 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.764958 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.766729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:43.767627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:48.330021 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:48.332176 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:48.376330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:48.376921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.378120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:48.378120 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.378120 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:48.378120 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.378120 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.378120 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:48.378120 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.378120 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.379190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.380211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:48.744763 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:48.746631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:48.747040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:48.747328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.748415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:48.748415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.748415 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:48.748415 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.748415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.748415 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:48.748415 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.748415 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:48.750327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.750803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:48.751322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:48.751633 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:48.752214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:48.752441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.752974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:48.752974 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.752974 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:48.752974 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.752974 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.752974 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:48.752974 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.752974 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:48.753837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:48.754581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:48.754581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.754581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:48.754581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.754581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.754581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:48.754581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.754581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:48.755170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.755658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.756159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:48.756159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.756159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:48.756550 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:48.757032 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:48.757350 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:48.757651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.758121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:48.758121 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.758121 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:48.758121 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.758121 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.758121 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:48.758121 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.758121 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:48.758935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:48.759561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:48.759561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.759561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:48.759561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.759561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.759561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:48.759561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.759561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:48.760241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.760747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:48.761227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.761227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:48.762617 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:48.763348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:48.763739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:48.764033 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:48.764223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.764784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:48.764784 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.764784 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:48.764784 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.764784 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.764784 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:48.764784 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.764784 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.766503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:48.767012 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:53.331271 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:53.332728 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:53.372991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:53.373527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.374506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:53.374506 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.374506 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:53.374506 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.374506 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.374506 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:53.374506 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.374506 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.375585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.376174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:53.745584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:53.747628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:53.748073 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:53.748331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.749623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:53.749623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.749623 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:53.749623 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.749623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.749623 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:53.749623 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.749623 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:53.751546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.752382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:53.753368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:53.753368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:53.753368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:53.753368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.753939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:53.753939 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.753939 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:53.753939 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.753939 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.753939 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:53.753939 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.753939 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:53.754798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:53.755690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:53.755690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.755690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:53.755690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.755690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.755690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:53.755690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.755690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:53.756170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.756988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.758105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:53.758105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.758105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:53.758105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:53.758913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:53.759442 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:53.759690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.760183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:53.760183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.760183 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:53.760183 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.760183 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.760183 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:53.760183 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.760183 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:53.760888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:53.761359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:53.761359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.761359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:53.761359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.761359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.761359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:53.761359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.761359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:53.761895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.762384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:53.762909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.762909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:53.763577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:53.764210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:53.764620 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:53.764853 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:53.765032 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.766099 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:53.766099 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.766099 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:53.766099 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.766099 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.766099 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:53.766099 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.766099 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.768052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:53.768581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:58.332078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:58.333935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:58.372430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:58.372653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.373265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:35:58.373265 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.373265 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:58.373265 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.373265 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.373265 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:58.373265 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.373265 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.374189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.374645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:58.746440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:58.748028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:58.748376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:58.748716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.749804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:35:58.749804 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.749804 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:58.749804 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.749804 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.749804 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:58.749804 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.749804 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:58.751490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.752016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:58.752517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:58.753247 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:35:58.753739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:58.753968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.754547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:58.754547 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.754547 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:58.754547 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.754547 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.754547 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:58.754547 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.754547 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:58.756190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:58.756907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:58.756907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.756907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:58.756907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.756907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.756907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:58.756907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.756907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:35:58.757758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.758232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.758870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:58.758870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.758870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:58.758870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:58.758870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:58.759112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:58.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.759842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:58.759842 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.759842 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:58.759842 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.759842 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.759842 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:58.759842 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.759842 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:35:58.760620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:58.761096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:35:58.761096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.761096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:35:58.761096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.761096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.761096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:35:58.761096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.761096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:35:58.761640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.762119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:58.762616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.762616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:35:58.764084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:35:58.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:35:58.765103 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:58.765313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:35:58.765477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.766244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:35:58.766244 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.766244 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:35:58.766244 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.766244 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.766244 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:35:58.766244 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.766244 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.767500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:35:58.768000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:03.332865 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:03.334807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:03.374644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:03.375197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.375874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:03.375874 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.375874 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:03.375874 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.375874 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.375874 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:03.375874 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.375874 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.377340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.378278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:03.747447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:03.749090 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:03.749331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:03.749734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.750317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:36:03.750317 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.750317 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:03.750317 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.750317 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.750317 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:03.750317 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.750317 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:03.752395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.753120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:03.753746 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:03.753797 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:03.754259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:03.754431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.755060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:03.755060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.755060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:03.755060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.755060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.755060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:03.755060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.755060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:03.756332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:03.756854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:03.756854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.756854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:03.756854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.756854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.756854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:03.756854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.756854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:03.757739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.758307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.758865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:03.758865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.758865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:03.758865 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:03.759242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:03.759564 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:03.759760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.760235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:03.760235 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.760235 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:03.760235 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.760235 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.760235 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:03.760235 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.760235 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:03.761016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:03.761495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:03.761495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.761495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:03.761495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.761495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.761495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:03.761495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.761495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:03.762252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.762779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:03.763340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.763340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:03.764461 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:03.765029 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:03.765362 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:03.765521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:03.765634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.766092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:03.766092 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.766092 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:03.766092 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.766092 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.766092 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:03.766092 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.766092 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.767387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:03.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:08.333692 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:08.335984 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:08.376586 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:08.377443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.377673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:08.377673 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.377673 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:08.377673 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.377673 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.377673 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:08.377673 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.377673 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.378905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.379555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:08.748040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:08.751831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:08.751831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:08.751831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.753311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:36:08.753311 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.753311 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:08.753311 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.753311 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.753311 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:08.753311 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.753311 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:08.755816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.756903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.758729 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:08.759332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.760561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:08.761118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:08.761708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.763697 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:08.764511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:08.764994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:08.764994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.764994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:08.764994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.764994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.764994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:08.764994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.764994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:08.765441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.765958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:08.767867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.767867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:08.767867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:08.767867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:08.767867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:08.767867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:08.767867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.768590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:08.768590 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.768590 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:08.768590 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.768590 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.768590 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:08.768590 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.768590 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.769587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:08.770010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:13.335123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:13.337097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:13.372157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:13.372490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.373263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:13.373263 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.373263 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:13.373263 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.373263 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.373263 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:13.373263 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.373263 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.374293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.374723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:13.748779 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:13.749866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:13.750209 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:13.750209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.750747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:36:13.750747 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.750747 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:13.750747 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.750747 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.750747 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:13.750747 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.750747 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:13.751975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.752759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:13.756518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:13.757157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:13.757837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:13.758098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.758807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:13.758807 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.758807 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:13.758807 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.758807 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.758807 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:13.758807 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.758807 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:13.760037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.760499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:13.760979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:13.761575 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:13.762094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:13.762546 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:13.762630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.763237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:13.763237 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.763237 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:13.763237 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.763237 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.763237 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:13.763237 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.763237 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:13.764291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.765593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:13.766557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:13.767443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.768124 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.769407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:13.770174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:18.336476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:18.338327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:18.375398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:18.375828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.376978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:18.376978 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.376978 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:18.376978 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.376978 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.376978 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:18.376978 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.376978 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.378227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.379078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:18.749593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:18.751319 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:18.751797 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:18.752156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.753443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Traceback (most recent call last):
Mar 19 18:36:18.753443 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.753443 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:18.753443 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.753443 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.753443 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:18.753443 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.753443 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2f1c3133-053e-450e-bddb-a8853a8de9d6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:18.754755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.755495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:18.757247 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:18.757834 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:18.758437 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:18.758939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.759608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:18.759608 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.759608 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:18.759608 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.759608 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.759608 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:18.759608 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.759608 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:18.760728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:18.761546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:18.761546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.761546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:18.761546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.761546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.761546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:18.761546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.761546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:18.762692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.763486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.764044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:18.764044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.764044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:18.764044 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:18.764044 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:18.764044 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:18.764044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.764989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:18.764989 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.764989 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:18.764989 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.764989 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.764989 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:18.764989 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.764989 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:18.765700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:18.766219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:18.766219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.766219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:18.766219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.766219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.766219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:18.766219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.766219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:18.767136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.767617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:18.768283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.768283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:18.768283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:18.768283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:18.768283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:18.768470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:18.768607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.769272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:18.769272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.769272 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:18.769272 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.769272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.769272 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:18.769272 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.769272 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.770900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:18.771384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:23.337511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:23.339268 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:23.376022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:23.376437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.377457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:23.377457 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.377457 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:23.377457 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.377457 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.377457 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:23.377457 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.377457 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.378761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.380041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:23.750481 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:23.752908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:23.753336 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:23.753592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.754775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:23.754775 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.754775 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:23.754775 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.754775 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.754775 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:23.754775 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.754775 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:23.756426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.757228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:23.758167 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:23.758291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:23.758943 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:23.759283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.760077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:23.760077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.760077 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:23.760077 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.760077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.760077 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:23.760077 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.760077 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:23.761400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:23.762108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:23.762108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.762108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:23.762108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.762108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.762108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:23.762108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.762108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:23.763059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.763570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.764196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:23.764196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.764196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:23.764196 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:23.764196 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:23.764374 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:23.764487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.764983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:36:23.764983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.764983 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:23.764983 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.764983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.764983 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:23.764983 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.764983 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:23.765718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.766214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:23.766759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.767362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:23.768013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.768013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:23.768013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:23.768654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:23.769093 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:23.769485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:23.769485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.770062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:23.770062 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.770062 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:23.770062 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.770062 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.770062 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:23.770062 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.770062 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.771847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:23.772486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:28.338226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:28.340173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:28.378299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:28.378913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.380264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:28.380264 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.380264 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:28.380264 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.380264 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.380264 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:28.380264 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.380264 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.381533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.382497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:28.751503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:28.753348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:28.753791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:28.754420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.755177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:28.755177 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.755177 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:28.755177 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.755177 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.755177 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:28.755177 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.755177 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:28.756554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.757421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:28.758275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:28.758567 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:28.759288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:28.759691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.760346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:28.760346 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.760346 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:28.760346 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.760346 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.760346 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:28.760346 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.760346 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:28.761313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:28.762216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:28.762216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.762216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:28.762216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.762216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.762216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:28.762216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.762216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:28.762642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.763431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.764360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:28.764360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.764360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:28.764360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:28.764614 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:28.764975 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:28.765234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.765871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:36:28.765871 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.765871 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:28.765871 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.765871 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.765871 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:28.765871 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.765871 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:28.766718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.767470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:28.768031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.768657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:28.769220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.769220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:28.770108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:28.770760 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:28.771197 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:28.771420 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:28.771573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.772151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:28.772151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.772151 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:28.772151 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.772151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.772151 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:28.772151 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.772151 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.773493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:28.774022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:33.339212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:33.340453 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:33.382715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:33.382715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.383826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:33.383826 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.383826 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:33.383826 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.383826 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.383826 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:33.383826 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.383826 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.385197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:33.752510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:33.754273 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:33.754651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:33.754925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.756017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:33.756017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.756017 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:33.756017 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.756017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.756017 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:33.756017 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.756017 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:33.757399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.758229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:33.759037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:33.759037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:33.759353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:33.759647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.760401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:33.760401 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.760401 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:33.760401 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.760401 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.760401 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:33.760401 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.760401 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:33.761449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:33.762276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:33.762276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.762276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:33.762276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.762276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.762276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:33.762276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.762276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:33.762849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.763619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.764608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:33.764608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.764608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:33.764608 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:33.764826 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:33.765576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:33.766041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.766984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:36:33.766984 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.766984 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:33.766984 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.766984 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.766984 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:33.766984 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.766984 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:33.767949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.768393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:33.769027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.769544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:33.770077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.770077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:33.770565 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:33.771117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:33.771717 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:33.772235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:33.772551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.773604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:33.773604 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.773604 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:33.773604 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.773604 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.773604 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:33.773604 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.773604 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.775326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:33.775798 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:38.339923 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:38.341737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:38.379800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:38.380252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.381252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:38.381252 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.381252 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:38.381252 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.381252 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.381252 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:38.381252 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.381252 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.382210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.383200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:38.753479 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:38.755116 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:38.755425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:38.755425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.756366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:38.756366 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.756366 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:38.756366 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.756366 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.756366 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:38.756366 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.756366 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:38.757844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.758662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:38.759476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:38.759971 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:38.760695 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:38.760980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.761784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:38.761784 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.761784 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:38.761784 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.761784 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.761784 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:38.761784 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.761784 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:38.763533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:38.764414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:38.764414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.764414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:38.764414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.764414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.764414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:38.764414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.764414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:38.765429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.766160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.766765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:38.766765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.766765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:38.766765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:38.766765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:38.767246 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:38.767543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.768277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:38.768277 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.768277 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:38.768277 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.768277 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.768277 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:38.768277 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.768277 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:38.769077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:38.769581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:38.769581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.769581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:38.769581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.769581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.769581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:38.769581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.769581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:38.770070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.770561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:38.771226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.771226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:38.771226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:38.771639 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:38.772087 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:38.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:38.772554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.773165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:38.773165 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.773165 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:38.773165 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.773165 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.773165 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:38.773165 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.773165 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.774622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:38.775185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:43.340511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:43.342079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:43.344339 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:36:43.377754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:43.378127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.379122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:43.379122 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.379122 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:43.379122 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.379122 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.379122 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:43.379122 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.379122 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.380094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.380783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:43.754191 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:43.755467 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:43.756134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:43.756134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.757342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:43.757342 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.757342 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:43.757342 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.757342 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.757342 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:43.757342 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.757342 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:43.759383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.760017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:43.760619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:43.760619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:43.761060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:43.761283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.761811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:36:43.761811 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.761811 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:43.761811 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.761811 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.761811 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:43.761811 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.761811 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:43.762734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.763303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:43.763612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.764249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.764821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:43.764821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.764821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:43.766584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:43.766977 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:43.768030 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:43.768531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.769477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:43.769477 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.769477 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:43.769477 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.769477 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.769477 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:43.769477 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.769477 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:43.770415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:43.770935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:43.770935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.770935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:43.770935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.770935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.770935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:43.770935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.770935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:43.771406 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.771926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:43.772492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.772492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:43.772492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:43.772492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:43.772492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:43.772492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:43.772716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.773415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:43.773415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.773415 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:43.773415 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.773415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.773415 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:43.773415 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.773415 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.775105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:43.775600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:48.341271 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:48.342752 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:48.382601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:48.383377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.383809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:48.383809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.383809 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:48.383809 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.383809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.383809 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:48.383809 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.383809 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.384999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.386213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:48.755084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:48.756389 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:48.756645 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:48.756774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.757802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:48.757802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.757802 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:48.757802 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.757802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.757802 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:48.757802 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.757802 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:48.759866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.760349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:48.760864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:48.761200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:48.761639 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:48.761807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.762431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:36:48.762431 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.762431 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:48.762431 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.762431 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.762431 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:48.762431 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.762431 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:48.764117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.765342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:48.765923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.766857 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.767485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:48.767485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.767485 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:48.767485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:48.767485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:48.767823 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:48.768079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:48.768641 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.768641 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:48.768641 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.768641 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.768641 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:48.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:48.769838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:48.770389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:48.770389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.770389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:48.770389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.770389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.770389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:48.770389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.770389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:48.771516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.772267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:48.772807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.772807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:48.772807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:48.772807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:48.773184 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:48.773406 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:48.773565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.774237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:48.774237 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.774237 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:48.774237 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.774237 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.774237 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:48.774237 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.774237 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.776514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:48.777083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:53.341991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:53.343273 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:53.380348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:53.381023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.381361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:53.381361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.381361 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:53.381361 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.381361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.381361 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:53.381361 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.381361 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.382362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.383357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:53.755994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:53.757551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:53.757827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:53.758092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.759048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:53.759048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.759048 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:53.759048 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.759048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.759048 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:53.759048 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.759048 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:53.760868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.761665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:53.762535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:53.762535 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:53.762982 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:53.763270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.764222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:53.764222 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.764222 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:53.764222 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.764222 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.764222 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:53.764222 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.764222 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:53.765457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.766512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:53.767476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.768259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.768985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:53.768985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.768985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:53.768985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:53.768985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:53.768985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:53.768985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.769519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:36:53.769519 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.769519 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:53.769519 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.769519 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.769519 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:53.769519 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.769519 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:53.770380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.770816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:53.772348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.773052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:53.773679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.773679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:53.773679 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:53.773789 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:53.774444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:53.775182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:53.775182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.776155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:53.776155 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.776155 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:53.776155 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.776155 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.776155 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:53.776155 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.776155 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.777206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:53.777740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:58.342935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:58.344858 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:58.380341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:58.380789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.381900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:36:58.381900 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.381900 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:58.381900 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.381900 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.381900 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:58.381900 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.381900 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.382867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.383794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:58.756855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:58.758527 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:58.758786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:58.758982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.759925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:36:58.759925 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.759925 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:58.759925 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.759925 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.759925 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:58.759925 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.759925 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:58.761869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.762935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:58.763621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:58.763621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:36:58.763621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:58.763824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.764689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:36:58.764689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.764689 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:58.764689 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.764689 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.764689 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:58.764689 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.764689 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:58.765654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.766419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:36:58.766871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.767613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.768685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:58.768685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.768685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:58.768685 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:58.769516 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:58.770083 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:58.770083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.770451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:58.770451 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.770451 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:58.770451 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.770451 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.770451 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:58.770451 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.770451 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:36:58.772000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:58.772832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:36:58.772832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.772832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:36:58.772832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.772832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.772832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:36:58.772832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.772832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:36:58.773801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.774563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:58.775379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.775379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:36:58.775379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:36:58.775379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:36:58.775379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:58.775379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:36:58.775379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.776225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:36:58.776225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.776225 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:36:58.776225 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.776225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.776225 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:36:58.776225 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.776225 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.778062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:36:58.778505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:03.343691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:03.345686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:03.379347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:03.380028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.380917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:03.380917 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.380917 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:03.380917 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.380917 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.380917 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:03.380917 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.380917 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.381829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.382765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:03.757787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:03.759376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:03.759803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:03.760084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.761153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:03.761153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.761153 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:03.761153 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.761153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.761153 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:03.761153 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.761153 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:03.762654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.763483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:03.764295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:03.764295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:03.764295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:03.764622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.765473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:03.765473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.765473 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:03.765473 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.765473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.765473 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:03.765473 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.765473 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:03.766912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.767427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:03.768681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.769213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.769780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:03.769780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.769780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:03.769780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:03.769780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:03.770305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:03.770676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:03.771495 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.771495 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:03.771495 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.771495 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.771495 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:03.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:03.772831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:03.773296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:03.773296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.773296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:03.773296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.773296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.773296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:03.773296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.773296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:03.774484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.775005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:03.775495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.775495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:03.775495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:03.775693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:03.776300 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:03.776654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:03.776919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.777909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:03.777909 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.777909 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:03.777909 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.777909 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.777909 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:03.777909 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.777909 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.780598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:03.781142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:08.344470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:08.345734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:08.383423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:08.383423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.384173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:08.384173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.384173 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:08.384173 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.384173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.384173 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:08.384173 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.384173 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.385168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.385720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:08.758619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:08.760423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:08.760913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:08.761217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.765083 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:08.767014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:08.767014 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.767014 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:08.767014 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.767014 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.767014 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:08.767014 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.767014 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:08.767576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.768327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:08.769310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:08.769310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:08.769641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.770686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:08.771432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:08.771432 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.771432 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:08.771432 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.771432 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.771432 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:08.771432 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.771432 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:08.772356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:08.773379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.774204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:08.775143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:08.775906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:08.777462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:08.777968 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:08.779439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.780330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.781256 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.782154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:08.783111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:13.345108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:13.347341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:13.421043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:13.421408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.422151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:13.422151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.422151 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:13.422151 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.422151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.422151 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:13.422151 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.422151 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.423223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.424034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:13.759465 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:13.761212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:13.761497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:13.761723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.762790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:13.762790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.762790 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:13.762790 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.762790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.762790 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:13.762790 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.762790 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:13.764713 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.765674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:13.766808 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:13.766808 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:13.766986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:13.767212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.768392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:13.768392 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.768392 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:13.768392 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.768392 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.768392 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:13.768392 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.768392 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:13.769270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.769913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:13.770384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.770907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.771429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:13.771429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.771429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:13.771429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:13.771778 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:13.772187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:13.772432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.772893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:13.772893 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.772893 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:13.772893 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.772893 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.772893 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:13.772893 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.772893 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:13.774007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:13.774552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:13.774552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.774552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:13.774552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.774552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.774552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:13.774552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.774552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:13.774911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.775376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:13.775865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.775865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:13.776682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:13.777115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:13.777557 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:13.777786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:13.778170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.778682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:13.778682 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.778682 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:13.778682 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.778682 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.778682 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:13.778682 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.778682 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.779630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:13.780143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:18.345918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:18.347464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:18.392391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:18.392639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:18.393706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.393706 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:18.393706 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.393706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.393706 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:18.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.394722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.395734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:18.760384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:18.762263 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:18.762588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:18.762752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.763648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:18.763648 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.763648 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:18.763648 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.763648 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.763648 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:18.763648 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.763648 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:18.765023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.765874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:18.766845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:18.766960 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:18.767400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:18.767635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.768337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:18.768337 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.768337 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:18.768337 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.768337 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.768337 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:18.768337 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.768337 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:18.770098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.770848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:18.771995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.772462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.773020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:18.773020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.773020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:18.773020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:18.773020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:18.773280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:18.773568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.774094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:18.774094 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.774094 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:18.774094 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.774094 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.774094 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:18.774094 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.774094 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:18.775082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:18.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:18.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:18.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:18.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:18.776846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.777336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:18.777843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.777843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:18.777843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:18.778006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:18.778460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:18.778713 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:18.778890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.779518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:18.779518 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.779518 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:18.779518 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.779518 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.779518 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:18.779518 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.779518 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.781479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:18.782030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:23.346763 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:23.349168 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:23.394246 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:23.394246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.394972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:23.394972 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.394972 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:23.394972 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.394972 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.394972 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:23.394972 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.394972 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.396028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.397429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:23.761412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:23.763805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:23.764192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:23.764441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.765596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:23.765596 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.765596 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:23.765596 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.765596 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.765596 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:23.765596 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.765596 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:23.767430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.768315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:23.769274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:23.769274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:23.769458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:23.769723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.770232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:23.770232 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.770232 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:23.770232 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.770232 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.770232 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:23.770232 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.770232 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:23.771186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.771850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:23.772597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.773139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.773690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:23.773690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.773690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:23.773690 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:23.773690 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:23.773922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:23.774314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.774800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:23.774800 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.774800 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:23.774800 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.774800 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.774800 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:23.774800 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.774800 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:23.775557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.775970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:23.776564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.777075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:23.777726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.777726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:23.777726 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:23.778464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:23.779014 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:23.779234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:23.779423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.779999 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:23.779999 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.779999 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:23.779999 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.779999 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.779999 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:23.779999 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.779999 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.781824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:23.782586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:28.347754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:28.349430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:28.388424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:28.388845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.389964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:28.389964 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.389964 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:28.389964 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.389964 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.389964 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:28.389964 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.389964 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.391239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.392285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:28.762359 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:28.764434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:28.765002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:28.765346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.766568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:28.766568 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.766568 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:28.766568 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.766568 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.766568 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:28.766568 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.766568 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:28.768518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.769375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:28.770343 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:28.770343 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:28.770469 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:28.770659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.771486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:28.771486 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.771486 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:28.771486 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.771486 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.771486 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:28.771486 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.771486 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:28.772963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.773421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:28.774639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.775157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.775710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:28.775710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.775710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:28.775710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:28.775710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:28.775854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:28.776101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.776568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:28.776568 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.776568 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:28.776568 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.776568 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.776568 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:28.776568 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.776568 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:28.777372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:28.777858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:28.777858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.777858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:28.777858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.777858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.777858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:28.777858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.777858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:28.778454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.778968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:28.779533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.779533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:28.779533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:28.779533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:28.779754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:28.779991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:28.780149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.780590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:28.780590 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.780590 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:28.780590 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.780590 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.780590 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:28.780590 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.780590 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.781619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:28.782137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:33.348925 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:33.350866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:33.389946 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:33.390301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.391276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:33.391276 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.391276 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:33.391276 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.391276 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.391276 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:33.391276 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.391276 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.392534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.393578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:33.763244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:33.764997 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:33.765383 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:33.765637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.766767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:33.766767 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.766767 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:33.766767 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.766767 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.766767 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:33.766767 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.766767 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:33.768641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.769447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:33.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:33.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:33.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:33.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.772059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:33.772059 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.772059 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:33.772059 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.772059 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.772059 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:33.772059 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.772059 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:33.773274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.774134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:33.774646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.775414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.775996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:33.775996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.775996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:33.775996 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:33.775996 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:33.776342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:33.776686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.777388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:33.777388 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.777388 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:33.777388 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.777388 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.777388 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:33.777388 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.777388 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:33.778177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:33.779021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:33.779021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.779021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:33.779021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.779021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.779021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:33.779021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.779021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:33.779344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.780058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:33.780729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.780729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:33.780729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:33.780729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:33.780729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:33.780729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:33.781166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.781731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:33.781731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.781731 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:33.781731 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.781731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.781731 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:33.781731 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.781731 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.783538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:33.784265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:38.349820 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:38.351661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:38.388785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:38.389269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.390340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:38.390340 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.390340 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:38.390340 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.390340 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.390340 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:38.390340 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.390340 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.392605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.393706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:38.764054 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:38.765828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:38.766260 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:38.766502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.767918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:38.767918 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.767918 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:38.767918 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.767918 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.767918 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:38.767918 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.767918 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:38.770377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:38.772631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:38.772631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:38.772631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:38.772631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.773131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:38.773131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.773131 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:38.773131 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.773131 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.773131 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:38.773131 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.773131 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:38.774642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.775183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:38.776473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.777130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.777703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:38.777703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.777703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:38.777703 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:38.777703 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:38.777962 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:38.778142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.778954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:38.778954 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.778954 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:38.778954 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.778954 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.778954 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:38.778954 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.778954 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:38.780412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:38.780946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:38.780946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.780946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:38.780946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.780946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.780946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:38.780946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.780946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:38.782297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.782784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:38.783294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.783294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:38.783294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:38.783294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:38.783634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:38.783864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:38.784042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.784623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:38.784623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.784623 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:38.784623 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.784623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.784623 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:38.784623 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.784623 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.785923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:38.786531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:43.350630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:43.352533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:43.354591 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:37:43.387719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:43.388229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.389492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:43.389492 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.389492 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:43.389492 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.389492 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.389492 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:43.389492 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.389492 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.390575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.391435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:43.765088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:43.766539 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:43.766963 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:43.767256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.768545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:43.768545 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.768545 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:43.768545 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.768545 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.768545 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:43.768545 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.768545 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:43.770446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.771399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:43.772458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:43.772458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:43.772458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:43.772918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.773657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:43.773657 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.773657 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:43.773657 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.773657 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.773657 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:43.773657 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.773657 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:43.774589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.775132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:43.776049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.776719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.777418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:43.777418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.777418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:43.777418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:43.777669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:43.778030 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:43.778249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.778842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:43.778842 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.778842 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:43.778842 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.778842 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.778842 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:43.778842 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.778842 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:43.780051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.781613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:43.782494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:43.783703 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:43.784569 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:43.785052 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:43.785293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:43.785445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.786009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:43.786009 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.786009 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:43.786009 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.786009 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.786009 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:43.786009 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.786009 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.787074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:43.788179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:48.351446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:48.353261 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:48.392987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:48.393188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.394312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:48.394312 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.394312 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:48.394312 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.394312 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.394312 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:48.394312 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.394312 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.396417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.397309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:48.765778 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:48.766985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:48.767260 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:48.767435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.768397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:48.768397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.768397 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:48.768397 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.768397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.768397 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:48.768397 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.768397 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:48.770562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.771495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:48.772419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:48.772897 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:48.773578 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:48.773921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.774754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:48.774754 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.774754 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:48.774754 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.774754 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.774754 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:48.774754 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.774754 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:48.776340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.776873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:48.778077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.778562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.779139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:48.779139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.779139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:48.779139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:48.779139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:48.779736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:48.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.781170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:48.781170 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.781170 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:48.781170 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.781170 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.781170 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:48.781170 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.781170 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:48.782607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:48.783139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:48.783139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.783139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:48.783139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.783139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.783139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:48.783139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.783139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:48.784252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.784740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:48.785296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.785296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:48.785296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:48.785296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:48.785658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:48.785899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:48.786167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.786994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:48.786994 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.786994 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:48.786994 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.786994 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.786994 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:48.786994 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.786994 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.788641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:48.789409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:53.352201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:53.353661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:53.396060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:53.396353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.397214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:53.397214 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.397214 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:53.397214 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.397214 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.397214 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:53.397214 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.397214 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.398422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.399066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:53.766616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:53.768250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:53.768663 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:53.769034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.770110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:53.770110 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.770110 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:53.770110 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.770110 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.770110 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:53.770110 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.770110 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:53.772142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.772636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:53.773214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:53.773214 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:53.773480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:53.773697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.774450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:53.774450 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.774450 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:53.774450 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.774450 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.774450 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:53.774450 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.774450 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:53.775733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.776280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:53.777324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.777793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.778478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:53.778478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.778478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:53.778850 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:53.779373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:53.779841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:53.780025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.780469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:53.780469 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.780469 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:53.780469 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.780469 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.780469 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:53.780469 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.780469 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:53.781270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:53.781754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:53.781754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.781754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:53.781754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.781754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.781754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:53.781754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.781754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:53.782067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.782575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:53.783114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.783114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:53.785039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:53.785277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:53.785473 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:53.785638 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:53.785769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.786129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:53.786129 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.786129 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:53.786129 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.786129 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.786129 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:53.786129 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.786129 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.786893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:53.787387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:58.353029 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:58.355173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:58.396831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:58.397270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.398330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:37:58.398330 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.398330 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:58.398330 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.398330 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.398330 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:58.398330 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.398330 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.399506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.400475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:58.767966 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:58.769380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:58.769773 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:58.770071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.771338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:37:58.771338 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.771338 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:58.771338 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.771338 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.771338 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:58.771338 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.771338 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:58.773334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.774180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:58.775017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:58.775017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:37:58.775438 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:58.775840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.776487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:37:58.776487 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.776487 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:58.776487 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.776487 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.776487 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:58.776487 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.776487 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:58.778041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.778555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:37:58.779777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.780291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.780780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:58.780780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.780780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:58.780780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:58.780780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:58.781624 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:58.782163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.783202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:58.783202 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.783202 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:58.783202 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.783202 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.783202 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:58.783202 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.783202 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:37:58.784505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:58.785003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:37:58.785003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.785003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:37:58.785003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.785003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.785003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:37:58.785003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.785003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:37:58.786257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.786764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:58.787337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.787337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:37:58.787337 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:37:58.787337 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:37:58.788297 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:58.789139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:37:58.789826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.790786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:37:58.790786 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.790786 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:37:58.790786 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.790786 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.790786 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:37:58.790786 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.790786 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.791933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:37:58.792543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:03.354338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:03.356368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:03.394897 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:03.395563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.396725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:03.396725 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.396725 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:03.396725 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.396725 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.396725 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:03.396725 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.396725 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.397942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.398757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:03.773126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:03.773983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:03.774148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:03.774297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.774599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:03.775664 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:03.776262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:03.776262 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.776262 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:03.776262 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.776262 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.776262 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:03.776262 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.776262 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:03.777573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.777924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:03.778341 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:03.778341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.778663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:03.778663 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.778663 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:03.778663 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.778663 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.778663 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:03.778663 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.778663 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:03.779678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.780000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:03.780827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.781307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.781790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:03.781790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.781790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:03.781790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:03.781790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:03.782332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:03.782592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.783256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:03.783256 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.783256 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:03.783256 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.783256 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.783256 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:03.783256 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.783256 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:03.784760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:03.785219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:03.785219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.785219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:03.785219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.785219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.785219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:03.785219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.785219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:03.786654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.787100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:03.787603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.787603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:03.787603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:03.787603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:03.788061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:03.788430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:03.788664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.789445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:03.789445 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.789445 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:03.789445 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.789445 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.789445 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:03.789445 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.789445 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.791176 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:03.791647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:08.355270 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:08.356640 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:08.389014 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:08.389361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.390348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:08.390348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.390348 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:08.390348 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.390348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.390348 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:08.390348 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.390348 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.391612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.393774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:08.773426 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:08.774682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:08.774908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:08.775079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.775503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:08.776224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:08.777098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:08.777098 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.777098 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:08.777098 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.777098 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.777098 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:08.777098 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.777098 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:08.778158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:08.779204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.779677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.780778 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:08.782084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.782632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:08.783059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:08.784587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.785140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.785761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:08.785761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.785761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:08.785761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:08.785761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:08.785961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.786370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:08.786370 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.786370 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:08.786370 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.786370 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.786370 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:08.786370 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.786370 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:08.787361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:08.788106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:08.788106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.788106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:08.788106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.788106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.788106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:08.788106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.788106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:08.788705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.789636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:08.790628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.790628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:08.790628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:08.790628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:08.790628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:08.790628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:08.790628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.791118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:08.791118 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.791118 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:08.791118 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.791118 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.791118 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:08.791118 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.791118 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.792744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:08.793678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:13.356028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:13.358454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:13.400588 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:13.401064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.402077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:13.402077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.402077 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:13.402077 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.402077 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.402077 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:13.402077 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.402077 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.403349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.404528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:13.774316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:13.776456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:13.777161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:13.777901 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:13.778490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:13.778864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.780288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:13.780288 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.780288 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:13.780288 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.780288 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.780288 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:13.780288 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.780288 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:13.821205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.821806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:13.822255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:13.822255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:13.822401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.823035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:13.824098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:13.824595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:13.825140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:13.825140 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.825140 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:13.825140 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.825140 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.825140 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:13.825140 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.825140 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:13.826434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:13.827212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:13.828084 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.828416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.828778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:13.828778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.828778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:13.828778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.829158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:13.829158 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.829158 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:13.829158 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.829158 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.829158 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:13.829158 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.829158 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:13.830250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:13.830606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:13.831521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.831880 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:13.832382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.832382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:13.832382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:13.832382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.832602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:13.832602 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.832602 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:13.832602 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.832602 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.832602 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:13.832602 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.832602 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.834302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:13.834784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:18.356835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:18.358859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:18.394120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:18.394405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.395173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:18.395173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.395173 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:18.395173 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.395173 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.395173 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:18.395173 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.395173 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.396652 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.397625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:18.775117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:18.776861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:18.777373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:18.777787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.778392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:18.778787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:18.779834 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:18.780206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.780992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:18.780992 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.780992 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:18.780992 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.780992 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.780992 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:18.780992 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.780992 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:18.782455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.783361 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:18.784109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.784747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.785514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.786350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:18.787011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.787011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:18.823310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:18.823724 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:18.824596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:18.825555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:18.826460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:18.826787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.827973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:18.828854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:18.828854 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.828854 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:18.828854 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.828854 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.828854 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:18.828854 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.828854 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:18.829304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:18.830914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:18.831369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:18.833082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.833613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.834163 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:18.835202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:23.357906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:23.359461 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:23.394131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:23.394366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.394851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:23.394851 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.394851 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:23.394851 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.394851 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.394851 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:23.394851 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.394851 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.396025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.396581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:23.775934 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:23.777579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:23.777800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:23.777928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.778950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:23.779542 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:23.780522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:23.780522 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.780522 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:23.780522 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.780522 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.780522 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:23.780522 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.780522 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:23.781191 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.782712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.783208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.783675 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:23.784785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:23.785281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:23.785281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.785281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:23.785281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.785281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.785281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:23.785281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.785281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:23.785854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.786339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.786819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:23.786819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.786819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:23.824533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:23.824913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:23.825831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:23.826419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:23.827005 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:23.827487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.828397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:23.828397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.828397 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:23.828397 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.828397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.828397 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:23.828397 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.828397 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:23.830153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:23.830817 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:23.831640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.832178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:23.832695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.832695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:23.858323 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:23.858822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.859017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:23.859017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.859017 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:23.859017 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.859017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.859017 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:23.859017 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.859017 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.859815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:23.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:28.358613 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:28.360238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:28.396291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:28.396596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.397400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:28.397400 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.397400 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:28.397400 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.397400 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.397400 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:28.397400 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.397400 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.398459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.399450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:28.776922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:28.778170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:28.778458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:28.778689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.779556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:28.780093 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:28.780684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:28.780684 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.780684 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:28.780684 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.780684 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.780684 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:28.780684 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.780684 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:28.781191 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.782649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.783415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:28.784223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.784753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:28.785249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.785685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.786206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:28.786206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.786206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:28.825250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:28.826192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:28.826738 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:28.827617 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:28.828538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:28.829172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.830195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:28.830195 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.830195 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:28.830195 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.830195 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.830195 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:28.830195 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.830195 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:28.831606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:28.832542 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:28.833432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.834159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.835029 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.836926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:28.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:33.359331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:33.361171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:33.403667 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:33.404201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.405412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:33.405412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.405412 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:33.405412 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.405412 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.405412 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:33.405412 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.405412 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.406790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.407330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:33.777867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:33.779301 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:33.779774 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:33.780071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.781278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:33.781278 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.781278 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:33.781278 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.781278 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.781278 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:33.781278 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.781278 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:33.782487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.785051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.786114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:33.787038 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:33.787038 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:33.787038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.787320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:33.787320 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.787320 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:33.787320 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.787320 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.787320 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:33.787320 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.787320 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:33.788791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:33.789651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:33.789651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.789651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:33.789651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.789651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.789651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:33.789651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.789651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:33.790636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.791437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.791967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:33.791967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.791967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:33.825908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:33.826613 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:33.827338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:33.827871 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:33.828618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:33.829187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.829970 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:33.830187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:33.830355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.830976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:33.830976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.830976 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:33.830976 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.830976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.830976 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:33.830976 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.830976 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:33.831515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:33.831515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.831515 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:33.831515 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.831515 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.831515 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:33.831515 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.831515 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.833478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.834287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:33.835056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.835685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:33.836495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:33.837232 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:33.837952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:33.837952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:38.360402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:38.362178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:38.400568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:38.401126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.402258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:38.402258 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.402258 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:38.402258 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.402258 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.402258 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:38.402258 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.402258 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.403550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.404722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:38.778657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:38.780590 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:38.781007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:38.781316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.782461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:38.782461 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.782461 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:38.782461 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.782461 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.782461 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:38.782461 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.782461 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.784788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.786266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.787375 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:38.788355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:38.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:38.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:38.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:38.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:38.789845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.790364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.790866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:38.790866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.790866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:38.826468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:38.827326 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:38.827860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:38.829078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:38.829669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:38.830244 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.832054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:38.832054 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.832054 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:38.832054 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.832054 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.832054 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:38.832054 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.832054 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:38.834209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:38.835024 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:38.837094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.838030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.838933 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.840170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:38.841072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:43.361255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:43.362831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:43.364935 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:38:43.411037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:43.411499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.412563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:43.412563 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.412563 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:43.412563 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.412563 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.412563 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:43.412563 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.412563 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.413891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.414355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:43.779583 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:43.781367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:43.781761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:43.782052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.783165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:43.783165 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.783165 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:43.783165 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.783165 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.783165 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:43.783165 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.783165 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.785120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.786033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:43.786956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:43.786956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:43.786956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:43.787296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.788162 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:43.788162 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.788162 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:43.788162 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.788162 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.788162 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:43.788162 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.788162 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:43.789619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:43.790228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:43.790228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.790228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:43.790228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.790228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.790228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:43.790228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.790228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:43.791264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.791746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.792322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:43.792322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.792322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:43.827045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:43.827858 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:43.828616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:43.829216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.829758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:43.830552 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:43.831423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:43.831423 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.831423 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:43.831423 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.831423 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.831423 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:43.831423 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.831423 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:43.832687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:43.833409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:43.835326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.836152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.837100 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.838897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:43.839463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:48.362016 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:48.364132 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:48.401914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:48.402136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.402917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:48.402917 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.402917 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:48.402917 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.402917 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.402917 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:48.402917 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.402917 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.403944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.404578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:48.780444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:48.782215 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:48.782659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:48.782981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.784195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:48.784195 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.784195 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:48.784195 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.784195 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.784195 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:48.784195 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.784195 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.786104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.787055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:48.787932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:48.787932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:48.787932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:48.787932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.788872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:48.788872 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.788872 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:48.788872 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.788872 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.788872 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:48.788872 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.788872 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:48.790248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:48.790683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:48.790683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.790683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:48.790683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.790683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.790683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:48.790683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.790683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:48.791859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.792302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.792750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:48.792750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.792750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:48.827658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:48.828447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:48.829201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:48.829613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.830593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:48.830593 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.830593 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:48.830593 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.830593 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.830593 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:48.830593 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.830593 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:48.831050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:48.833147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:48.833909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:48.835965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.836767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:48.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:48.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:48.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:48.837691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.837976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:48.837976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.837976 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:48.837976 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.837976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.837976 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:48.837976 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.837976 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.839869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:48.840470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:53.362848 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:53.364366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:53.411571 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:53.412064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.413307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:53.413307 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.413307 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:53.413307 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.413307 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.413307 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:53.413307 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.413307 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.414306 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.414835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:53.781436 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:53.783135 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:53.783532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:53.783790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.784830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:53.784830 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.784830 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:53.784830 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.784830 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.784830 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:53.784830 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.784830 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.786271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.787210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:53.788215 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:53.788215 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:53.788215 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:53.788414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.789209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:53.789209 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.789209 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:53.789209 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.789209 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.789209 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:53.789209 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.789209 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:53.790321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:53.791255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:53.791255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.791255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:53.791255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.791255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.791255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:53.791255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.791255 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:53.792028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.793003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.794009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:53.794009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.794009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:53.828344 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:53.828843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:53.829652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:53.830189 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.831305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:53.831305 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.831305 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:53.831305 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.831305 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.831305 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:53.831305 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.831305 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:53.832833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:53.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:53.835635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.836337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:53.837305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.837305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:53.837305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:53.837305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:53.837305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:53.837547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.838061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:38:53.838061 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.838061 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:53.838061 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.838061 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.838061 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:53.838061 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.838061 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.839161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:53.839690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:58.363732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:58.365650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:58.404413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:58.404954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.405824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:38:58.405824 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.405824 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:58.405824 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.405824 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.405824 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:58.405824 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.405824 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.406923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.407846 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:58.782361 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:58.784220 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:58.784656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:58.784891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.786070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:58.786070 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.786070 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:58.786070 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.786070 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.786070 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:58.786070 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.786070 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.788151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.789151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:58.789665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:58.789665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:38:58.789665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:58.789665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.790105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:38:58.790105 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.790105 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:58.790105 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.790105 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.790105 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:58.790105 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.790105 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:58.790815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:58.791359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:58.791359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.791359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:58.791359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.791359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.791359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:58.791359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.791359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:38:58.791841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.792354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.792843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:58.792843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.792843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:58.828732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:58.829618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:58.830313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:58.830759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.831701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:58.831701 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.831701 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:58.831701 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.831701 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.831701 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:58.831701 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.831701 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:38:58.833283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.833992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:38:58.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.836095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:58.836923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.836923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:38:58.836923 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:38:58.836923 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:38:58.836923 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:58.837226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:38:58.837226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.837719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:38:58.837719 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.837719 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:38:58.837719 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.837719 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.837719 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:38:58.837719 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.837719 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.838754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:38:58.839294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:03.364581 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:03.366362 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:03.408076 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:03.408642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.409712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:39:03.409712 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.409712 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:03.409712 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.409712 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.409712 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:03.409712 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.409712 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.411002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.412019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:03.783337 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:03.785155 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:03.785597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:03.785988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.786805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:03.786805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.786805 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:03.786805 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.786805 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.786805 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:03.786805 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.786805 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.788726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.789807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:03.790806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:03.790806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:03.790806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:03.790806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.791327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:03.791327 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.791327 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:03.791327 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.791327 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.791327 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:03.791327 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.791327 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:03.792699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:03.793219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:03.793219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.793219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:03.793219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.793219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.793219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:03.793219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.793219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:03.794492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.795034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.795569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:03.795569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.795569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:03.829211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:03.830259 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:03.830613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.831416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:03.831416 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.831416 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:03.831416 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.831416 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.831416 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:03.831416 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.831416 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:03.832795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.833521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:03.834548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.835292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:03.835815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.835815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:03.836144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:03.837061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:03.837570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:03.837991 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:03.838685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.839610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:03.839610 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.839610 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:03.839610 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.839610 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.839610 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:03.839610 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.839610 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.841509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:03.842049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:08.365462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:08.367337 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:08.410775 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:08.411186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.412678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:39:08.412678 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.412678 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:08.412678 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.412678 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.412678 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:08.412678 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.412678 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.414031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.414950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:08.784510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:08.785487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:08.785669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:08.785860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.786455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:08.786455 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.786455 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:08.786455 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.786455 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.786455 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:08.786455 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.786455 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.787521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.788391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:08.789600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:08.790390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:08.790849 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:08.791054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.791504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:08.791504 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.791504 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:08.791504 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.791504 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.791504 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:08.791504 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.791504 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:08.792201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:08.792775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:08.792775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.792775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:08.792775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.792775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.792775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:08.792775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.792775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:08.793135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.793651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.794261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:08.794261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.794261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:08.830181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:08.830640 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:08.831104 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:08.831483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.832272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:08.832272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.832272 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:08.832272 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.832272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.832272 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:08.832272 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.832272 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:08.833578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.834579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:08.835345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.836371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:08.837573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.837573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:08.837573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:08.837573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:08.837573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:08.838006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:08.838006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.838487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:08.838487 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.838487 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:08.838487 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.838487 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.838487 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:08.838487 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.838487 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.839504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:08.840030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:13.366437 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:13.368270 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:13.405921 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:13.406359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.407225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:39:13.407225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.407225 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:13.407225 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.407225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.407225 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:13.407225 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.407225 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.408245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.409187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:13.785126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:13.786873 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:13.787333 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:13.787769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.788567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:13.788567 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.788567 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:13.788567 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.788567 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.788567 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:13.788567 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.788567 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.790299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.791457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:13.792495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:13.792495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:13.792495 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:13.792495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.792861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:13.792861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.792861 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:13.792861 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.792861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.792861 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:13.792861 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.792861 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:13.794097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:13.795381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:13.795381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.795381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:13.795381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.795381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.795381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:13.795381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.795381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:13.795852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.796381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.796975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:13.796975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.796975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:13.830689 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:13.831368 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:13.832503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:13.833029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.834136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:13.834136 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.834136 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:13.834136 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.834136 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.834136 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:13.834136 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.834136 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:13.835502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.836091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:13.838282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.838831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:13.839587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.839587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:13.839587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:13.839587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:13.839771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:13.840186 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:13.840429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.841321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:13.841321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.841321 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:13.841321 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.841321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.841321 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:13.841321 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.841321 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.842903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:13.843428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:18.367306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:18.369260 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:18.403468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:18.404030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.404997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:39:18.404997 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.404997 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:18.404997 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.404997 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.404997 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:18.404997 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.404997 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.406118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.407021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:18.785926 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:18.787596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:18.788470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:18.788624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.789666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:18.789666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.789666 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:18.789666 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.789666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.789666 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:18.789666 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.789666 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.791734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.792591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:18.793423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:18.793423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:18.793423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:18.793423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.794061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:18.794061 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.794061 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:18.794061 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.794061 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.794061 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:18.794061 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.794061 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:18.795194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:18.795747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:18.795747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.795747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:18.795747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.795747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.795747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:18.795747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.795747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:18.796441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.796934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.797404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:18.797404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.797404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:18.831583 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:18.832454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:18.833229 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:18.833608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.834362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:18.834362 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.834362 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:18.834362 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.834362 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.834362 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:18.834362 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.834362 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:18.835825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.836848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:18.837521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.838570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:18.839784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.839784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:18.839784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:18.840435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:18.840859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:18.841271 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:18.841518 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.842296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:18.842296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.842296 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:18.842296 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.842296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.842296 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:18.842296 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.842296 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.844004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:18.844708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:23.368090 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:23.370074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:23.406278 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:23.406694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.407611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:39:23.407611 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.407611 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:23.407611 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.407611 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.407611 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:23.407611 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.407611 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.408384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.409398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:23.786999 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:23.788481 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:23.788776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:23.789048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.789902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:23.789902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.789902 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:23.789902 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.789902 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.789902 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:23.789902 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.789902 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.791736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.792557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:23.793467 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:23.793467 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:23.793665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:23.794062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.794839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:23.794839 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.794839 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:23.794839 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.794839 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.794839 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:23.794839 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.794839 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:23.795679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:23.796515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:23.796515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.796515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:23.796515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.796515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.796515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:23.796515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.796515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:23.796966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.797702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.798809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:23.798809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.798809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:23.832285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:23.832811 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:23.833366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:23.833691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.834397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:23.834397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.834397 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:23.834397 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.834397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.834397 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:23.834397 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.834397 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:23.836020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.836521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:23.837906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.838864 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:23.839858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.839858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:23.840327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:23.841272 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:23.841686 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:23.842007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:23.842119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.842954 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:23.842954 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.842954 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:23.842954 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.842954 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.842954 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:23.842954 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.842954 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.843825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:23.844391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:28.369035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:28.370860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:28.412026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:28.412469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.413583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:39:28.413583 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.413583 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:28.413583 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.413583 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.413583 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:28.413583 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.413583 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.414656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.415604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:28.787732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:28.789133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:28.789510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:28.789726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.790654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:28.790654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.790654 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:28.790654 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.790654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.790654 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:28.790654 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.790654 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.791658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.792438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:28.793224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:28.793438 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:28.793901 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:28.794202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.794841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:28.794841 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.794841 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:28.794841 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.794841 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.794841 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:28.794841 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.794841 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:28.796049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:28.796807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:28.796807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.796807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:28.796807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.796807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.796807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:28.796807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.796807 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:28.797583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.798262 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.799075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:28.799075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.799075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:28.832757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:28.833824 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:28.834307 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:28.834540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.835251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:28.835251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.835251 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:28.835251 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.835251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.835251 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:28.835251 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.835251 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:28.836647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.837537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:28.838500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.839290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:28.840177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.840177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:28.840754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:28.841767 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:28.842293 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:28.842628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:28.842962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.843754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:28.843754 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.843754 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:28.843754 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.843754 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.843754 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:28.843754 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.843754 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.845487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:28.846017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:33.369707 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:33.371574 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:33.419703 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:33.419703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.420903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:39:33.420903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.420903 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:33.420903 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.420903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.420903 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:33.420903 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.420903 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.422080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.423137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:33.788847 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:33.790316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:33.790677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:33.790973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.792038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:33.792038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.792038 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:33.792038 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.792038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.792038 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:33.792038 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.792038 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.793848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.794728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:33.795573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:33.795573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:33.795573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:33.795760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.796665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:33.796665 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.796665 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:33.796665 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.796665 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.796665 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:33.796665 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.796665 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:33.798180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:33.799133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:33.799133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.799133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:33.799133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.799133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.799133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:33.799133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.799133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:33.800430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.801293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.802230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:33.802230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.802230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:33.833683 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:33.834570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:33.835585 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:33.836211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.837169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:33.837169 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.837169 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:33.837169 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.837169 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.837169 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:33.837169 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.837169 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:33.838594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.839467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:33.840276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.841301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:33.842207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.842207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:33.842207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:33.842207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:33.842529 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:33.842780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:33.842944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.843552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:33.843552 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.843552 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:33.843552 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.843552 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.843552 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:33.843552 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.843552 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.845373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:33.845947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:37.989872 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:38.003363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:389}}
Mar 19 18:39:38.003805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=103900) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:370}}
Mar 19 18:39:38.003805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Fixing resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:39:38.044355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, resource={'id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'name': 'private', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb', 'bee598c2-f62b-4321-b08d-23e3a7c6ccb9'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:09:27Z', 'updated_at': '2026-03-19T18:09:31Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 29513}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.044661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.044937 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b55270e8-5359-4f54-8804-fcbd7769eee3, external_ids_update=None, columns={'tag': 29513}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.045038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.045962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:38.045962 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.045962 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.045962 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.045962 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.045962 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.045962 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.045962 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Failed to fix resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.048164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.048570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.048987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:39:38.048987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.048987 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:39:38.048987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Fixing resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:39:38.083681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, resource={'id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'name': 'public', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['7888df47-ce34-4091-9e08-c1c5949f53a2', 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-03-19T18:09:34Z', 'updated_at': '2026-03-19T18:09:44Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.084079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.084200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-20b6196a-9254-4b37-a645-8253845242a7, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.084327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.085067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:38.085067 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.085067 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.085067 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.085067 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.085067 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.085067 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.085067 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Failed to fix resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.086534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.087184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.087918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:39:38.087918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.087918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:39:38.087918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Fixing resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:39:38.142329 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-420e2995-aa57-46db-9651-85807f50bcb9, resource={'id': '420e2995-aa57-46db-9651-85807f50bcb9', 'name': 'admin_net', 'tenant_id': '1ed140779dbc462d89fd3e785886b2bb', 'project_id': '1ed140779dbc462d89fd3e785886b2bb', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['388b450f-f17e-4671-94e9-9f169d754be7'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:13:33Z', 'updated_at': '2026-03-19T18:13:34Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 28229}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.142555 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-420e2995-aa57-46db-9651-85807f50bcb9, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.142786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-07b4049d-60f0-4621-a8e7-5dcac93308be, external_ids_update=None, columns={'tag': 28229}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.142868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.143587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:38.143587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.143587 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.143587 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.143587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.143587 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.143587 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.143587 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Failed to fix resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.145402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.145726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.146127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:39:38.146127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.146127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:39:38.146127 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Fixing resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:39:38.181237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, resource={'id': '4d64a793-ee68-4a18-b938-f55304c6fcf6', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0bc68cc0-48dc-4abe-bbac-0a4f654efb2e'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:14:20Z', 'updated_at': '2026-03-19T18:14:21Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 59295}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.181558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.181660 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-42ff4b0a-bf0a-4937-bf0f-c8b42f68f267, external_ids_update=None, columns={'tag': 59295}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.181740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.182484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:38.182484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.182484 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.182484 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.182484 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.182484 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.182484 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.182484 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Failed to fix resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.183901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.184293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.184728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:39:38.184728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.184728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:39:38.184728 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Fixing resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:39:38.273388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, resource={'id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'enable_snat': True}, 'gw_port_id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-1id6n', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'ip_address': '172.24.5.52', 'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, {'ip_address': '2001:db8::2c3', 'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:25Z', 'revision_number': 3, 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89'}, resource_type=routers, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.273713 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.273713 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.273811 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.273852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.274468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:38.274468 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.274468 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.274468 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.274468 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.274468 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.274468 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.274468 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.274730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Unable to update router cf5e0251-94c8-4bce-b873-648b8cc72809. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Failed to fix resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Mar 19 18:39:38.275960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:39:38.276378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:39:38.276802 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Fixing resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:39:38.371101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:38.373787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:38.433330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, resource={'id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'name': '', 'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'project_id': '', 'mac_address': 'fa:16:3e:11:31:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000160124', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:24Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.433625 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::2c3/64', '172.24.5.52/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.433892 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=f319bf7e-5d34-47af-b620-bec8597c3819, lrouter_port=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.434079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.435609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:38.435609 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.435609 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.435609 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.435609 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.435609 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.435609 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.435609 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Failed to fix resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.436664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.437074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.437600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:39:38.437600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.437600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:39:38.437600 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Maintenance task: Synchronization completed (took 0.43 seconds)
Mar 19 18:39:38.439245 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.439416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.440003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:39:38.440003 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.440003 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.440003 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.440003 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.440003 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.440003 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.440003 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.441941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:38.789663 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:38.791353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.791745 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.792096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.793050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:38.793050 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.793050 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.793050 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.793050 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.793050 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.793050 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.793050 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.795024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.795828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:38.796594 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:38.796594 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:38.796827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.797143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.797908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:38.797908 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.797908 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.797908 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.797908 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.797908 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.797908 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.797908 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:38.799814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.801000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:38.801000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.801000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:38.801000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.801000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.801000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:38.801000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.801000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:38.801600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.802401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.803401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:38.803401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.803401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:38.834476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:38.835417 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:38.836079 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.836434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.837207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:38.837207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.837207 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.837207 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.837207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.837207 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.837207 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.837207 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:38.838297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.838711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:38.839432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.839866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:38.840362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.840362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:38.841703 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:38.842384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:38.842887 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.843264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:38.843486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.844297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:38.844297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.844297 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:38.844297 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.844297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.844297 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:38.844297 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.844297 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.846079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:38.846945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:43.372512 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:43.374139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:43.375990 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=434 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:39:43.414166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:43.414696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.415985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:43.415985 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.415985 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:43.415985 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.415985 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.415985 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:43.415985 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.415985 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.416995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.418404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:43.790450 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:43.792085 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:43.792449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:43.792872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.793774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:43.793774 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.793774 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:43.793774 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.793774 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.793774 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:43.793774 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.793774 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.795685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.796284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:43.796786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:43.796786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:43.797297 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:43.797532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.798261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:43.798261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.798261 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:43.798261 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.798261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.798261 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:43.798261 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.798261 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:43.799866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:43.800478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:43.800478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.800478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:43.800478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.800478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.800478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:43.800478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.800478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:43.801811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.802341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.802867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:43.802867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.802867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:43.835536 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:43.836342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:43.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:43.837566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.838626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:43.838626 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.838626 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:43.838626 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.838626 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.838626 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:43.838626 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.838626 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:43.839672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.840584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:43.841052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.841692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:43.842392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.842392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:43.842392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:43.843087 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:43.843516 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:43.843812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:43.844026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.844649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:43.844649 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.844649 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:43.844649 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.844649 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.844649 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:43.844649 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.844649 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.845941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:43.846683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:48.373248 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:48.375101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:48.414870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:48.416050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.416820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:48.416820 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.416820 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:48.416820 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.416820 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.416820 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:48.416820 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.416820 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.418599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.419737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:48.791243 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:48.793484 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:48.794011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:48.794361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.795549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:48.795549 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.795549 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:48.795549 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.795549 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.795549 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:48.795549 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.795549 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.797895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.798986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:48.799973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:48.799973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:48.799973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:48.799973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.800224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:48.800224 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.800224 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:48.800224 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.800224 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.800224 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:48.800224 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.800224 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:48.801179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:48.802036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:48.802036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.802036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:48.802036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.802036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.802036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:48.802036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.802036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:48.802436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.803155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.804025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:48.804025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.804025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:48.836365 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:48.837465 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:48.838670 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:48.839375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.840424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:48.840424 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.840424 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:48.840424 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.840424 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.840424 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:48.840424 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.840424 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:48.841560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.842524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:48.843093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.844024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:48.845237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.845237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:48.845237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:48.845237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:48.845568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:48.845741 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:48.846014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.846854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:48.846854 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.846854 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:48.846854 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.846854 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.846854 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:48.846854 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.846854 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.848379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:48.848996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:53.374142 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:53.376047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:53.417349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:53.417788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.418997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:53.418997 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.418997 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:53.418997 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.418997 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.418997 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:53.418997 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.418997 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.419797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.421080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:53.792279 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:53.794128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:53.794574 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:53.794834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.796340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:53.796340 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.796340 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:53.796340 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.796340 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.796340 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:53.796340 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.796340 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.797513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.798035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:53.798614 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:53.799205 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:53.799648 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:53.799869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.800466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:53.800466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.800466 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:53.800466 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.800466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.800466 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:53.800466 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.800466 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:53.801854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:53.802337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:53.802337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.802337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:53.802337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.802337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.802337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:53.802337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.802337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:53.803503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.803992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.804550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:53.804550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.804550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:53.837737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:53.839111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:53.839111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:53.839907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.840587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:53.840587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.840587 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:53.840587 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.840587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.840587 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:53.840587 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.840587 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:53.842203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.843092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:53.843543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.844732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:53.845582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.845582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:53.845582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:53.845582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:53.845582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:53.845582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:53.845582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.846060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:53.846060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.846060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:53.846060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.846060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.846060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:53.846060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.846060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.846612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:53.847210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:58.374903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:58.377026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:58.415183 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:58.415704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.416778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:39:58.416778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.416778 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:58.416778 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.416778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.416778 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:58.416778 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.416778 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.417789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.418632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:58.793300 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:58.795108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:58.795540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:58.795829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.797028 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:58.797028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.797028 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:58.797028 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.797028 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.797028 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:58.797028 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.797028 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.798994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.799838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:58.800866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:58.800866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:39:58.800866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:58.800866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.801635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:39:58.801635 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.801635 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:58.801635 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.801635 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.801635 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:58.801635 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.801635 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:58.802626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:58.803425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:58.803425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.803425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:58.803425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.803425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.803425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:58.803425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.803425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:39:58.803769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.804542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.805369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:58.805369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.805369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:58.838943 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:58.839560 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:58.840211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:58.840587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.841415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:39:58.841415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.841415 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:58.841415 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.841415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.841415 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:58.841415 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.841415 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:39:58.842418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.843434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:39:58.844088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.845136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:58.846287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.846287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:39:58.846287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:39:58.846287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:39:58.846287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:58.846287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:39:58.846287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.846847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:39:58.846847 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.846847 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:39:58.846847 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.846847 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.846847 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:39:58.846847 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.846847 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.848685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:39:58.849164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:03.375793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:03.377679 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:03.419710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:03.420150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.421103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:03.421103 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.421103 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:03.421103 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.421103 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.421103 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:03.421103 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.421103 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.422666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.423774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:03.794117 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:03.796091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:03.796499 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:03.796791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.797810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:03.797810 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.797810 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:03.797810 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.797810 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.797810 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:03.797810 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.797810 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.799589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.800135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:03.800637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:03.800637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:03.801265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:03.801596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.802479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:03.802479 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.802479 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:03.802479 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.802479 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.802479 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:03.802479 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.802479 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:03.803956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:03.804450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:03.804450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.804450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:03.804450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.804450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.804450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:03.804450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.804450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:03.805527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.806013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.806669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:03.806669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.806669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:03.839634 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:03.840058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:03.840711 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:03.841212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.841968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:03.841968 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.841968 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:03.841968 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.841968 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.841968 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:03.841968 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.841968 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:03.843074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.843551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:03.844266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.844752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:03.845285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.845285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:03.845285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:03.845716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:03.846181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:03.846631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:03.846897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.847721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:03.847721 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.847721 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:03.847721 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.847721 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.847721 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:03.847721 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.847721 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:03.849986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:08.376644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:08.378374 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:08.417488 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:08.417854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.418993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:08.418993 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.418993 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:08.418993 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.418993 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.418993 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:08.418993 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.418993 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.420117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.421286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:08.795069 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:08.796739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:08.797175 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:08.797438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.798503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:08.798503 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.798503 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:08.798503 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.798503 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.798503 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:08.798503 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.798503 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.800582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.801488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:08.802305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:08.802305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:08.802305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:08.802580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.803403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:08.803403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.803403 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:08.803403 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.803403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.803403 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:08.803403 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.803403 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:08.805120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:08.805625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:08.805625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.805625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:08.805625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.805625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.805625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:08.805625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.805625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:08.806344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.806811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.807356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:08.807356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.807356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:08.840219 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:08.840742 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:08.841497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:08.842026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.842911 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:08.842911 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.842911 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:08.842911 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.842911 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.842911 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:08.842911 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.842911 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:08.844400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.845201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:08.846217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.846691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:08.847228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.847228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:08.847228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:08.847558 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:08.848144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:08.848505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:08.848749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.849604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:08.849604 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.849604 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:08.849604 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.849604 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.849604 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:08.849604 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.849604 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.851544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:08.852094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:13.377488 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:13.379064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:13.416432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:13.416859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.417892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:13.417892 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.417892 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:13.417892 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.417892 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.417892 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:13.417892 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.417892 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.418825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.419349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:13.796156 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:13.797608 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:13.797608 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:13.797837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.798700 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:13.798700 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.798700 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:13.798700 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.798700 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.798700 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:13.798700 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.798700 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.800484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.800969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:13.801717 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:13.802097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:13.802460 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:13.802672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.803204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:13.803204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.803204 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:13.803204 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.803204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.803204 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:13.803204 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.803204 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:13.803970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:13.804432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:13.804432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.804432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:13.804432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.804432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.804432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:13.804432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.804432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:13.804928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.805324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.805781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:13.805781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.805781 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:13.841045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:13.841688 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:13.842475 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:13.843113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.843945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:13.843945 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.843945 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:13.843945 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.843945 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.843945 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:13.843945 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.843945 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:13.844539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:13.845628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:13.846353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:13.847352 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:13.848008 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:13.848316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:13.848657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:13.848965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.849778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:13.849778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.849778 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:13.849778 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.849778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.849778 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:13.849778 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.849778 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.851599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:13.852199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:18.378210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:18.379734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:18.417149 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:18.417429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.418170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:18.418170 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.418170 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:18.418170 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.418170 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.418170 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:18.418170 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.418170 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.419109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.420015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:18.796589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:18.798614 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:18.799125 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:18.799341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.800529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:18.800529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.800529 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:18.800529 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.800529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.800529 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:18.800529 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.800529 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.802585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.803448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:18.804286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:18.804286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:18.804286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:18.804484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.805394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:18.805394 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.805394 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:18.805394 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.805394 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.805394 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:18.805394 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.805394 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:18.806653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:18.807245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:18.807245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.807245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:18.807245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.807245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.807245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:18.807245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.807245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:18.808295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.808797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.809386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:18.809386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.809386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:18.841573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:18.842603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:18.843353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:18.843732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.844769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:18.844769 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.844769 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:18.844769 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.844769 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.844769 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:18.844769 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.844769 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:18.846569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.847670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:18.848913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.849451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:18.850104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.850104 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:18.850104 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:18.850233 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:18.851089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:18.851464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:18.851676 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.852607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:18.852607 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.852607 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:18.852607 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.852607 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.852607 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:18.852607 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.852607 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.854845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:18.855397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:23.379062 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:23.382192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:23.418907 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:23.419264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.420453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:23.420453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.420453 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:23.420453 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.420453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.420453 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:23.420453 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.420453 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.421804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.422837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:23.797344 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:23.799032 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:23.799386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:23.799584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.800699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:23.800699 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.800699 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:23.800699 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.800699 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.800699 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:23.800699 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.800699 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.802443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.803532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:23.804621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:23.804621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:23.804781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:23.805135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.805894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:23.805894 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.805894 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:23.805894 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.805894 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.805894 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:23.805894 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.805894 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:23.806705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:23.807631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:23.807631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.807631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:23.807631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.807631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.807631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:23.807631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.807631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:23.808172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.808892 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.809396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:23.809396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.809396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:23.842254 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:23.842699 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:23.843693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:23.844238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.845272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:23.845272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.845272 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:23.845272 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.845272 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.845272 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:23.845272 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.845272 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:23.846271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.847014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:23.847413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.848246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:23.849222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.849222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:23.850097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:23.850448 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:23.850918 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:23.851283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:23.851520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.852388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:23.852388 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.852388 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:23.852388 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.852388 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.852388 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:23.852388 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.852388 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.854052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:23.855043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:28.380501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:28.382795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:28.428497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:28.428852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.429762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:28.429762 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.429762 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:28.429762 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.429762 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.429762 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:28.429762 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.429762 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.431199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.431723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:28.798447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:28.799898 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:28.800381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:28.800696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.801771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:28.801771 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.801771 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:28.801771 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.801771 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.801771 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:28.801771 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.801771 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.802855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.803990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:28.805275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:28.805275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:28.805275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:28.805490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.806195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:28.806195 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.806195 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:28.806195 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.806195 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.806195 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:28.806195 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.806195 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:28.807536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:28.808186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:28.808186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.808186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:28.808186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.808186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.808186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:28.808186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.808186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:28.809246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.810252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:28.810252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.810252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:28.843637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:28.844446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:28.845662 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:28.846089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.847132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:28.847132 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.847132 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:28.847132 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.847132 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.847132 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:28.847132 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.847132 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:28.848726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.849455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:28.850463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.851319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:28.852198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.852198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:28.852198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:28.852198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:28.852198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:28.852198 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:28.852198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.852872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:28.852872 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.852872 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:28.852872 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.852872 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.852872 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:28.852872 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.852872 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.854096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:28.854850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:33.381271 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:33.382319 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:33.419714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:33.420174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.421046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:33.421046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.421046 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:33.421046 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.421046 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.421046 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:33.421046 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.421046 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.422342 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.423381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:33.799618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:33.801841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:33.802290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:33.802538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.804096 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:33.804096 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.804096 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:33.804096 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.804096 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.804096 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:33.804096 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.804096 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.806499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.807053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:33.807577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:33.807577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:33.808710 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:33.809394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.810324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:33.810324 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.810324 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:33.810324 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.810324 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.810324 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:33.810324 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.810324 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:33.810863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:33.811643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:33.811643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.811643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:33.811643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.811643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.811643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:33.811643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.811643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:33.812077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.812603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.813201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:33.813201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.813201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:33.844357 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:33.845126 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:33.845798 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:33.846195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.847062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:33.847062 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.847062 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:33.847062 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.847062 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.847062 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:33.847062 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.847062 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:33.848535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.849035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:33.850372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.850865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:33.852603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.852603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:33.852603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:33.852603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:33.852603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:33.853123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:33.853263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.854053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:33.854053 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.854053 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:33.854053 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.854053 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.854053 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:33.854053 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.854053 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.855401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:33.856548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:38.382415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:38.384845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:38.421422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:38.421898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.422984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:38.422984 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.422984 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:38.422984 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.422984 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.422984 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:38.422984 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.422984 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.424041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.425011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:38.801043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:38.802429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:38.802857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:38.803178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.804433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:38.804433 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.804433 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:38.804433 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.804433 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.804433 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:38.804433 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.804433 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.806410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.807221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:38.807704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:38.807704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:38.808132 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:38.808476 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.809261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:38.809261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.809261 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:38.809261 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.809261 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.809261 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:38.809261 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.809261 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:38.810178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:38.810674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:38.810674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.810674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:38.810674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.810674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.810674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:38.810674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.810674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:38.811298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.811758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.812379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:38.812379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.812379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:38.845121 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:38.845637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:38.846662 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:38.847290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.848357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:38.848357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.848357 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:38.848357 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.848357 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.848357 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:38.848357 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.848357 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:38.849848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.850602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:38.851707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.852504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:38.853355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.853355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:38.853355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:38.853355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:38.853355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:38.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:38.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.854194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:38.854194 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.854194 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:38.854194 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.854194 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.854194 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:38.854194 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.854194 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.855260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:38.855747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:43.383400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:43.385407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:43.387805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:40:43.419145 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:43.419580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.420614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:43.420614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.420614 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:43.420614 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.420614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.420614 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:43.420614 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.420614 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.421822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.422939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:43.801855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:43.803780 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:43.804283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:43.804576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.805695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:43.805695 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.805695 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:43.805695 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.805695 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.805695 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:43.805695 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.805695 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.807726 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.808610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:43.809461 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:43.809461 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:43.809793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:43.811179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.812217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:43.812217 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.812217 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:43.812217 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.812217 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.812217 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:43.812217 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.812217 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:43.812907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.813922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:43.814772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.815699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:43.845961 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:43.846603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:43.847432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:43.847844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.848847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:43.848847 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.848847 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:43.848847 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.848847 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.848847 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:43.848847 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.848847 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:43.850559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.851344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:43.852480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.853236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:43.854067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.854067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:43.854067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:43.854067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:43.854067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:43.854433 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:43.854581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.855395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:43.855395 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.855395 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:43.855395 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.855395 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.855395 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:43.855395 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.855395 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.857923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:43.858932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:48.384478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:48.386149 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:48.427801 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:48.428273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.429249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:48.429249 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.429249 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:48.429249 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.429249 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.429249 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:48.429249 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.429249 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.431005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.432229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:48.802867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:48.804545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:48.805017 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:48.805206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.806271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:48.806271 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.806271 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:48.806271 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.806271 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.806271 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:48.806271 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.806271 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.808060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.808998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:48.809712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:48.809712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:48.809712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:48.809712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.810109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:48.810109 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.810109 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:48.810109 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.810109 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.810109 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:48.810109 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.810109 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:48.810845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:48.811543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:48.811543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.811543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:48.811543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.811543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.811543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:48.811543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.811543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:48.811972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.812540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.813299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:48.813299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.813299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:48.846421 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:48.846980 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:48.847830 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:48.848280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.849168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:48.849168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.849168 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:48.849168 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.849168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.849168 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:48.849168 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.849168 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:48.850650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.851391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:48.852779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.853657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:48.854163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.854163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:48.854163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:48.854163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:48.854309 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:48.854643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:48.854904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.855788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:48.855788 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.855788 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:48.855788 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.855788 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.855788 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:48.855788 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.855788 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.857560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:48.858274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:53.385340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:53.387250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:53.423695 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:53.424193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.425421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:53.425421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.425421 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:53.425421 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.425421 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.425421 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:53.425421 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.425421 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.426499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.427226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:53.803869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:53.805224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:53.805598 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:53.805598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.806491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:53.806491 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.806491 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:53.806491 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.806491 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.806491 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:53.806491 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.806491 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.808315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.809197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:53.810953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:53.810953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:53.810953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:53.810953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.811385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:53.811385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.811385 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:53.811385 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.811385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.811385 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:53.811385 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.811385 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:53.813133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:53.813734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:53.813734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.813734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:53.813734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.813734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.813734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:53.813734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.813734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:53.815074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.815598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.816167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:53.816167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.816167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:53.847228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:53.848039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:53.848866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:53.849327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.850373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:53.850373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.850373 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:53.850373 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.850373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.850373 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:53.850373 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.850373 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:53.851893 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.852655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:53.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.854532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:53.855470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.855470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:53.855470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:53.855470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:53.855470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:53.855786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:53.855851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.856858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:53.856858 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.856858 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:53.856858 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.856858 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.856858 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:53.856858 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.856858 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.858847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:53.859763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:58.386282 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:58.387490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:58.424174 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:58.424733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.425936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:40:58.425936 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.425936 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:58.425936 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.425936 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.425936 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:58.425936 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.425936 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.427310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.428466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:58.804685 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:58.806338 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:58.806921 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:58.806921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.807963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:58.807963 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.807963 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:58.807963 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.807963 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.807963 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:58.807963 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.807963 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.810687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.811308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:58.811799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:58.812053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:40:58.812581 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:58.812840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.813432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:40:58.813432 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.813432 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:58.813432 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.813432 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.813432 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:58.813432 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.813432 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:58.815058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:58.815597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:58.815597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.815597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:58.815597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.815597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.815597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:58.815597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.815597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:40:58.816643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.817138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.817657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:58.817657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.817657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:58.848194 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:58.849166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:58.849909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:58.850437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.851462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:40:58.851462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.851462 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:58.851462 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.851462 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.851462 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:58.851462 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.851462 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:40:58.852465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.853199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:40:58.853623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.854387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:58.855231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.855231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:40:58.855231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:40:58.855231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:40:58.855470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:58.855772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:40:58.855976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.856613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:40:58.856613 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.856613 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:40:58.856613 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.856613 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.856613 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:40:58.856613 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.856613 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.858714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:40:58.859332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:03.387143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:03.389032 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:03.423917 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:03.424597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.425786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:03.425786 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.425786 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:03.425786 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.425786 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.425786 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:03.425786 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.425786 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.426858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.427836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:03.805597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:03.807380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:03.807852 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:03.808155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.809253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:03.809253 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.809253 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:03.809253 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.809253 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.809253 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:03.809253 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.809253 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.811069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.812151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:03.813207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:03.813207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:03.813803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:03.814116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.814768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:03.814768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.814768 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:03.814768 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.814768 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.814768 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:03.814768 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.814768 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:03.815836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:03.816426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:03.816426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.816426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:03.816426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.816426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.816426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:03.816426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.816426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:03.817015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.817629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.818144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:03.818144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.818144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:03.848862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:03.849677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:03.850304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:03.850597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.851229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:03.851229 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.851229 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:03.851229 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.851229 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.851229 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:03.851229 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.851229 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:03.852041 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.852503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:03.853350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.853833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:03.854491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.854491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:03.854895 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:03.855840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:03.856391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:03.856930 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:03.856930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.857685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:03.857685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.857685 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:03.857685 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.857685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.857685 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:03.857685 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.857685 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.859606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:03.860163 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:08.387908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:08.389995 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:08.426081 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:08.426471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.428919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:08.428919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.428919 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:08.428919 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.428919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.428919 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:08.428919 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.428919 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.430385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.431336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:08.806513 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:08.808055 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:08.808484 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:08.808747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:08.809732 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.809732 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:08.809732 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.809732 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.809732 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:08.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.809732 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.811685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.812516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:08.813587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:08.813587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:08.813587 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:08.813773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.814678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:08.814678 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.814678 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:08.814678 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.814678 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.814678 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:08.814678 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.814678 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:08.815352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:08.815977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:08.815977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.815977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:08.815977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.815977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.815977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:08.815977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.815977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:08.816414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.816997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.817441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:08.817441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.817441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:08.849462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:08.849908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:08.850500 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:08.850940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.851720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:08.851720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.851720 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:08.851720 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.851720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.851720 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:08.851720 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.851720 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:08.853205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.854395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:08.854980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.855723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:08.856488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.856488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:08.856488 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:08.856488 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:08.856901 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:08.857253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:08.857479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.858426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:08.858426 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.858426 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:08.858426 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.858426 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.858426 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:08.858426 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.858426 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.861496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:08.862295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:13.388730 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:13.390681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:13.436469 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:13.437003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.438071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:13.438071 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.438071 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:13.438071 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.438071 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.438071 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:13.438071 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.438071 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.439133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.439677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:13.807209 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:13.808828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:13.809277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:13.809551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.810712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:13.810712 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.810712 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:13.810712 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.810712 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.810712 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:13.810712 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.810712 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.812568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.813731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.814677 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:13.815628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:13.816465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:13.816465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.816465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:13.816465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.816465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.816465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:13.816465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.816465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:13.817217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.817678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.818239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:13.818239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.818239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:13.849910 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:13.850653 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:13.851224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:13.851686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.852401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:13.852401 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.852401 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:13.852401 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.852401 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.852401 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:13.852401 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.852401 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:13.853636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.854386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:13.855474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.856295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:13.856810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.856810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:13.856810 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:13.856810 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:13.857124 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:13.857498 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:13.857741 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.858505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:13.858505 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.858505 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:13.858505 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.858505 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.858505 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:13.858505 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.858505 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.860381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:13.860983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:18.389629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:18.391712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:18.427682 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:18.427989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.428747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:18.428747 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.428747 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:18.428747 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.428747 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.428747 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:18.428747 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.428747 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.430130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.431000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:18.808030 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:18.809554 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:18.810000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:18.810259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.811167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:18.811167 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.811167 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:18.811167 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.811167 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.811167 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:18.811167 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.811167 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.813080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.813660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:18.814210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:18.814210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:18.814210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:18.814349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.814896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:18.814896 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.814896 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:18.814896 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.814896 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.814896 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:18.814896 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.814896 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:18.815653 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:18.816220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:18.816220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.816220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:18.816220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.816220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.816220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:18.816220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.816220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:18.816698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.817332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.818021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:18.818021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.818021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:18.850462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:18.851278 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:18.852101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:18.852532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.853570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:18.853570 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.853570 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:18.853570 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.853570 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.853570 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:18.853570 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.853570 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:18.855071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.855479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:18.856734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.857235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:18.857905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.857905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:18.857905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:18.857905 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:18.858388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:18.858729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:18.858888 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.859511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:18.859511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.859511 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:18.859511 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.859511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.859511 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:18.859511 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.859511 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.860472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:18.861076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:23.390452 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:23.392455 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:23.430037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:23.430490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.431567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:23.431567 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.431567 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:23.431567 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.431567 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.431567 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:23.431567 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.431567 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.432531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.433423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:23.808866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:23.810220 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:23.810530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:23.810775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.811764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:23.811764 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.811764 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:23.811764 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.811764 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.811764 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:23.811764 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.811764 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.813503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.813939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:23.814718 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:23.815382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:23.815791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:23.816129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.816894 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:23.816894 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.816894 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:23.816894 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.816894 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.816894 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:23.816894 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.816894 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:23.817627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:23.819585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.820483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:23.851294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:23.851789 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:23.852431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:23.852898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.853809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:23.853809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.853809 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:23.853809 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.853809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.853809 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:23.853809 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.853809 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:23.855199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.855929 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:23.857024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.857753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:23.858626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.858626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:23.858626 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:23.858626 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:23.858867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:23.859115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:23.859445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.860216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:23.860216 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.860216 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:23.860216 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.860216 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.860216 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:23.860216 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.860216 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.861903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:23.862457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:28.391627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:28.393119 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:28.423735 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:28.424036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.424731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:28.424731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.424731 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:28.424731 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.424731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.424731 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:28.424731 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.424731 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.425716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.426241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:28.809584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:28.811631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:28.812066 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:28.812329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.813534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:28.813534 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.813534 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:28.813534 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.813534 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.813534 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:28.813534 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.813534 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.815495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.816344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:28.817221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:28.817221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:28.817440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:28.817660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.818426 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:28.818426 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.818426 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:28.818426 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.818426 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.818426 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:28.818426 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.818426 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:28.820158 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:28.821026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:28.821026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.821026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:28.821026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.821026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.821026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:28.821026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.821026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:28.821823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.822311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.822988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:28.822988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.822988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:28.852182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:28.853004 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:28.853684 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:28.854171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.855112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:28.855112 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.855112 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:28.855112 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.855112 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.855112 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:28.855112 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.855112 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:28.856462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.857156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:28.858420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.859177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:28.860146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.860146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:28.860146 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:28.860146 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:28.860356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:28.860531 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:28.860693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.861387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:28.861387 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.861387 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:28.861387 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.861387 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.861387 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:28.861387 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.861387 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.863415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:28.864393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:33.392410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:33.394645 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:33.432425 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:33.432842 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.433853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:33.433853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.433853 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:33.433853 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.433853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.433853 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:33.433853 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.433853 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.435181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.436073 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:33.810827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:33.812310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:33.812602 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:33.812801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.813801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:33.813801 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.813801 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:33.813801 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.813801 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.813801 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:33.813801 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.813801 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.815756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.816837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:33.817606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:33.817606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:33.817792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:33.818040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.818737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:33.818737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.818737 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:33.818737 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.818737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.818737 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:33.818737 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.818737 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:33.820375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:33.821065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:33.821065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.821065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:33.821065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.821065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.821065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:33.821065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.821065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:33.822205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.822937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.823709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:33.823709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.823709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:33.852950 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:33.853398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:33.854397 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:33.854895 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.855986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:33.855986 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.855986 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:33.855986 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.855986 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.855986 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:33.855986 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.855986 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:33.857510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.858208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:33.859260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.860048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:33.860856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.860856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:33.860856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:33.860856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:33.860856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:33.861180 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:33.861238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.862182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:33.862182 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.862182 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:33.862182 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.862182 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.862182 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:33.862182 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.862182 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.863456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:33.864338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:38.393723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:38.395387 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:38.441356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:38.441749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.442784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:38.442784 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.442784 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:38.442784 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.442784 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.442784 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:38.442784 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.442784 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.444148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.445344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:38.811674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:38.813415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:38.813794 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:38.814094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.815129 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:38.815129 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.815129 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:38.815129 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.815129 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.815129 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:38.815129 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.815129 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.817539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.818573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:38.819363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:38.819363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:38.819363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:38.819590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.820327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:38.820327 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.820327 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:38.820327 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.820327 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.820327 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:38.820327 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.820327 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:38.822091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:38.822930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:38.822930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.822930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:38.822930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.822930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.822930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:38.822930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.822930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:38.824153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.824910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.825719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:38.825719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.825719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:38.853464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:38.854125 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:38.854863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:38.855300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.856240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:38.856240 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.856240 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:38.856240 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.856240 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.856240 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:38.856240 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.856240 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:38.857559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.858170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:38.859282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.859940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:38.860776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.860776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:38.860776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:38.860953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:38.861531 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:38.861860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:38.862121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.862903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:38.862903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.862903 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:38.862903 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.862903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.862903 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:38.862903 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.862903 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.864326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:38.865093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:43.394304 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:43.395690 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:43.397727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:41:43.439405 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:43.439850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.440932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:43.440932 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.440932 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:43.440932 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.440932 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.440932 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:43.440932 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.440932 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.442398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.443867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:43.812437 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:43.814075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:43.814343 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:43.814521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.815379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:43.815379 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.815379 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:43.815379 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.815379 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.815379 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:43.815379 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.815379 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.817409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.818517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:43.819366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:43.819366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:43.819514 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:43.819739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.820351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:43.820351 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.820351 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:43.820351 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.820351 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.820351 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:43.820351 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.820351 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:43.821323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:43.822281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:43.822281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.822281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:43.822281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.822281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.822281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:43.822281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.822281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:43.822545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.823030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.823602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:43.823602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.823602 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:43.854167 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:43.855053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:43.856234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:43.856665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.857779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:43.857779 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.857779 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:43.857779 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.857779 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.857779 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:43.857779 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.857779 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:43.859327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.860067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:43.861524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.862354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:43.863210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.863210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:43.863210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:43.863210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:43.863210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:43.863210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:43.863550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.864461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:43.864461 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.864461 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:43.864461 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.864461 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.864461 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:43.864461 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.864461 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.865475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:43.866107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:48.395097 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:48.397523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:48.436760 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:48.437474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.438078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:48.438078 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.438078 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:48.438078 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.438078 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.438078 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:48.438078 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.438078 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.439184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.440138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:48.813396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:48.815083 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:48.815429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:48.815682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.816596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:48.816596 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.816596 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:48.816596 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.816596 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.816596 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:48.816596 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.816596 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.818214 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.818756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:48.819357 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:48.819357 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:48.819857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:48.820203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.821062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:48.821062 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.821062 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:48.821062 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.821062 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.821062 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:48.821062 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.821062 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:48.821978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:48.822962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:48.822962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.822962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:48.822962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.822962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.822962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:48.822962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.822962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:48.823491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.824022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.824578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:48.824578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.824578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:48.855013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:48.856305 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:48.857125 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:48.857534 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.858587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:48.858587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.858587 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:48.858587 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.858587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.858587 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:48.858587 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.858587 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:48.860138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.860948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:48.861907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.863030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:48.864000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.864000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:48.864000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:48.864000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:48.864000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:48.864527 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:48.864689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.865505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:48.865505 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.865505 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:48.865505 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.865505 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.865505 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:48.865505 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.865505 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.867330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:48.867904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:53.396006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:53.399034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:53.429596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:53.430049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.431081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:53.431081 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.431081 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:53.431081 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.431081 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.431081 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:53.431081 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.431081 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.432134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.433135 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:53.814403 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:53.816059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:53.816653 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:53.816778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.817780 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:53.817780 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.817780 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:53.817780 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.817780 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.817780 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:53.817780 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.817780 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.820043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.820554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:53.821356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:53.821356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:53.821356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:53.822072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.822383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:53.822383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.822383 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:53.822383 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.822383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.822383 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:53.822383 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.822383 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:53.823612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:53.824412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:53.824412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.824412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:53.824412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.824412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.824412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:53.824412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.824412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:53.825383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.826171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.827025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:53.827025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.827025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:53.855806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:53.856726 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:53.857597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:53.858137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.859310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:53.859310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.859310 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:53.859310 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.859310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.859310 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:53.859310 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.859310 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:53.860843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.861547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:53.862263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.863049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:53.863946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.863946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:53.863946 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:53.863946 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:53.864244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:53.864652 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:53.865008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.866396 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:53.866396 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.866396 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:53.866396 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.866396 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.866396 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:53.866396 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.866396 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.867805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:53.868506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:58.396549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:58.398179 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:58.438059 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:58.438521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.439620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:41:58.439620 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.439620 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:58.439620 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.439620 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.439620 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:58.439620 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.439620 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.441076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.442229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:58.815181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:58.816764 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:58.817310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:58.817658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.818717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:58.818717 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.818717 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:58.818717 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.818717 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.818717 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:58.818717 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.818717 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.820670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.821530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:58.822276 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:58.822276 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:41:58.822276 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:58.822612 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.823018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:41:58.823018 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.823018 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:58.823018 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.823018 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.823018 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:58.823018 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.823018 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:58.824497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:58.825031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:58.825031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.825031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:58.825031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.825031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.825031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:58.825031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.825031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:41:58.826544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.827590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.828497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:58.828497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.828497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:58.856501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:58.857501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:58.858152 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:58.858683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.859635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:41:58.859635 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.859635 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:58.859635 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.859635 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.859635 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:58.859635 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.859635 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:41:58.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.861859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:41:58.863279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.863896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:58.864409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.864409 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:41:58.864409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:41:58.864409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:41:58.864799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:58.865204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:41:58.865486 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.866403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:41:58.866403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.866403 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:41:58.866403 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.866403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.866403 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:41:58.866403 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.866403 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.867757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:41:58.868310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:03.397320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:03.399142 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:03.441536 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:03.442056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.443191 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:03.443191 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.443191 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:03.443191 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.443191 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.443191 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:03.443191 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.443191 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.444812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.445840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:03.815939 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:03.817553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:03.817981 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:03.818238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.819348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:03.819348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.819348 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:03.819348 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.819348 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.819348 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:03.819348 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.819348 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.821429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.822308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:03.823101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:03.823101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:03.823236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:03.823553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.824425 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:03.824425 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.824425 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:03.824425 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.824425 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.824425 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:03.824425 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.824425 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:03.825747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:03.826364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:03.826364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.826364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:03.826364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.826364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.826364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:03.826364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.826364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:03.827290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.827760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.828293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:03.828293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.828293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:03.857190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:03.857690 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:03.858394 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:03.858748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.859592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:03.859592 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.859592 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:03.859592 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.859592 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.859592 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:03.859592 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.859592 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:03.861141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.861847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:03.862871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.863649 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:03.865045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.865045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:03.865045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:03.865045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:03.865468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:03.865914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:03.866206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.867259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:03.867259 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.867259 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:03.867259 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.867259 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.867259 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:03.867259 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.867259 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.869223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:03.869973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:08.398227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:08.400861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:08.439821 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:08.440309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.441335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:08.441335 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.441335 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:08.441335 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.441335 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.441335 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:08.441335 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.441335 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.442588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.444195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:08.816941 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:08.818534 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:08.818969 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:08.819245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.820314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:08.820314 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.820314 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:08.820314 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.820314 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.820314 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:08.820314 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.820314 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.822427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.823462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:08.824556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:08.824556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:08.824556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:08.824556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.825226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:08.825226 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.825226 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:08.825226 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.825226 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.825226 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:08.825226 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.825226 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:08.826165 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:08.827024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:08.827024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.827024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:08.827024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.827024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.827024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:08.827024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.827024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:08.827432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.828227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.829108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:08.829108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.829108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:08.857852 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:08.858435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:08.858967 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:08.859341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.860501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:08.860501 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.860501 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:08.860501 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.860501 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.860501 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:08.860501 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.860501 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:08.862118 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.862868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:08.864153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.865070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:08.866061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.866061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:08.866061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:08.866061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:08.866562 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:08.867046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:08.867355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:08.868366 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.868366 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:08.868366 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.868366 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.868366 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:08.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.870071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:08.870866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:13.399101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:13.400723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:13.438178 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:13.438492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.439374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:13.439374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.439374 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:13.439374 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.439374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.439374 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:13.439374 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.439374 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.440603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.441541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:13.817676 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:13.819327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:13.819666 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:13.819906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.820966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:13.820966 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.820966 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:13.820966 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.820966 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.820966 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:13.820966 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.820966 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.822625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.823814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:13.824753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:13.824753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:13.824927 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:13.825168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.825848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:13.825848 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.825848 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:13.825848 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.825848 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.825848 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:13.825848 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.825848 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:13.827112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:13.827978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:13.827978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.827978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:13.827978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.827978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.827978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:13.827978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.827978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:13.828317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.828745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.829239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:13.829239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.829239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:13.858335 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:13.859106 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:13.859754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:13.860198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.861134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:13.861134 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.861134 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:13.861134 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.861134 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.861134 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:13.861134 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.861134 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:13.861906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.862829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:13.863483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.864541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:13.865734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.865734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:13.865734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:13.866164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:13.866659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:13.867096 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:13.867463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.868414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:13.868414 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.868414 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:13.868414 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.868414 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.868414 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:13.868414 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.868414 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.870331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:13.871047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:18.399994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:18.402193 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:18.439156 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:18.439464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.440450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:18.440450 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.440450 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:18.440450 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.440450 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.440450 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:18.440450 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.440450 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.441710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.442866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:18.818435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:18.819772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:18.820249 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:18.820528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.821658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:18.821658 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.821658 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:18.821658 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.821658 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.821658 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:18.821658 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.821658 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.823238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.823593 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:18.824471 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:18.825215 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:18.825838 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:18.826203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.827055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:18.827055 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.827055 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:18.827055 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.827055 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.827055 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:18.827055 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.827055 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:18.828533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:18.829370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:18.829370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.829370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:18.829370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.829370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.829370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:18.829370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.829370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:18.830199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.831004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.831746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:18.831746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.831746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:18.859096 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:18.859849 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:18.860857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:18.861127 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.862101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:18.862101 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.862101 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:18.862101 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.862101 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.862101 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:18.862101 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.862101 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:18.863606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.864333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:18.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.866355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:18.867236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.867236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:18.867236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:18.867236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:18.867236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:18.867735 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:18.868101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.868981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:18.868981 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.868981 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:18.868981 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.868981 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.868981 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:18.868981 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.868981 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.870685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:18.871438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:23.400913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:23.404074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:23.438911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:23.439345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.440353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:23.440353 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.440353 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:23.440353 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.440353 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.440353 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:23.440353 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.440353 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.441457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.442434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:23.819442 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:23.821096 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:23.821398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:23.822097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.822536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:23.822536 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.822536 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:23.822536 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.822536 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.822536 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:23.822536 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.822536 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.824235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.825249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:23.826112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:23.826112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:23.826324 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:23.826908 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.827819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:23.827819 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.827819 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:23.827819 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.827819 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.827819 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:23.827819 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.827819 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:23.829130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:23.830144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:23.830144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.830144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:23.830144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.830144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.830144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:23.830144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.830144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:23.830774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.831575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.832143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:23.832143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.832143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:23.860236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:23.860785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:23.861721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:23.862256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.863066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:23.863066 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.863066 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:23.863066 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.863066 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.863066 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:23.863066 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.863066 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:23.864848 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.865483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:23.866358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.866897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:23.867562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.867562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:23.867562 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:23.867562 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:23.867562 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:23.867562 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:23.867809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.868169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:23.868169 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.868169 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:23.868169 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.868169 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.868169 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:23.868169 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.868169 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.869001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:23.869599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:28.401782 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:28.403771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:28.452401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:28.452989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.454207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:28.454207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.454207 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:28.454207 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.454207 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.454207 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:28.454207 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.454207 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.455553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.456108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:28.820146 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:28.821708 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:28.822022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:28.822161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.823088 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:28.823088 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.823088 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:28.823088 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.823088 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.823088 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:28.823088 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.823088 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.824994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.825977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:28.826928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:28.826928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:28.826928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:28.826928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.827531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:28.827531 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.827531 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:28.827531 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.827531 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.827531 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:28.827531 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.827531 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:28.828408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:28.829327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:28.829327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.829327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:28.829327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.829327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.829327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:28.829327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.829327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:28.829743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.830501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.831435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:28.831435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.831435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:28.861572 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:28.862377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:28.863329 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:28.863656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.864509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:28.864509 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.864509 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:28.864509 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.864509 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.864509 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:28.864509 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.864509 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:28.865992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.866721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:28.868021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:28.869736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.869736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:28.869736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:28.869736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:28.869736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:28.869736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:28.870146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.870572 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:28.870572 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.870572 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:28.870572 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.870572 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.870572 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:28.870572 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.870572 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.872211 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:28.873188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:33.402800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:33.404358 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:33.441260 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:33.441680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.443009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:33.443009 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.443009 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:33.443009 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.443009 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.443009 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:33.443009 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.443009 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.445159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.446101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:33.821008 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:33.822707 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:33.823182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:33.823805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.825049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:33.825049 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.825049 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:33.825049 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.825049 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.825049 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:33.825049 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.825049 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.826353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.827167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:33.828026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:33.828026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:33.828026 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:33.828286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.829340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:33.829340 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.829340 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:33.829340 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.829340 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.829340 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:33.829340 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.829340 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:33.830803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:33.831356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:33.831356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.831356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:33.831356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.831356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.831356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:33.831356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.831356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:33.832395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.833240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.833787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:33.833787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.833787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:33.862335 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:33.863211 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:33.863910 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:33.864371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.865320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:33.865320 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.865320 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:33.865320 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.865320 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.865320 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:33.865320 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.865320 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:33.866816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.867655 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:33.869004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.869855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:33.870380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.870380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:33.870380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:33.870491 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:33.871255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:33.871778 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:33.871972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.872801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:33.872801 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.872801 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:33.872801 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.872801 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.872801 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:33.872801 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.872801 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.874607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:33.875136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:38.403400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:38.406092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:38.442857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:38.443286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.444447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:38.444447 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.444447 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:38.444447 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.444447 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.444447 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:38.444447 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.444447 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.445683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.446645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:38.821766 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:38.823806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:38.825200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:38.825200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.826587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:38.826587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.826587 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:38.826587 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.826587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.826587 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:38.826587 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.826587 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.828585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.829688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:38.830242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:38.830242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:38.830242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:38.830369 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.830990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:38.830990 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.830990 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:38.830990 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.830990 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.830990 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:38.830990 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.830990 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:38.831735 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:38.832305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:38.832305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.832305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:38.832305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.832305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.832305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:38.832305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.832305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:38.833008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.833449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.833965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:38.833965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.833965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:38.863231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:38.864014 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:38.864822 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:38.865269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.866168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:38.866168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.866168 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:38.866168 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.866168 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.866168 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:38.866168 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.866168 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:38.867541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.868455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:38.869268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.870297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:38.871269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.871269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:38.871269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:38.871269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:38.871269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:38.871661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:38.871661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.872316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:38.872316 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.872316 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:38.872316 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.872316 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.872316 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:38.872316 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.872316 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.873969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:38.874494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:43.404226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:43.406227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:43.408626 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:42:43.440181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:43.440665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.441914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:43.441914 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.441914 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:43.441914 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.441914 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.441914 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:43.441914 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.441914 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.442903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.443854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:43.823153 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:43.824857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:43.825181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:43.825440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.826796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:43.826796 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.826796 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:43.826796 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.826796 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.826796 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:43.826796 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.826796 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.828695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.829820 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:43.830934 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:43.830934 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:43.830934 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:43.830934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.831413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:43.831413 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.831413 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:43.831413 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.831413 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.831413 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:43.831413 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.831413 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:43.832764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:43.833523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:43.833523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.833523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:43.833523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.833523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.833523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:43.833523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.833523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:43.834361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.834839 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.835357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:43.835357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.835357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:43.863937 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:43.864687 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:43.865463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:43.865906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.866921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:43.866921 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.866921 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:43.866921 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.866921 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.866921 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:43.866921 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.866921 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:43.868036 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.868800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:43.869298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.870131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:43.870949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.870949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:43.870949 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:43.871966 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:43.872477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:43.872721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:43.872902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.873514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:43.873514 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.873514 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:43.873514 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.873514 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.873514 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:43.873514 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.873514 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.874837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:43.875724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:48.405093 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:48.406859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:48.442039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:48.442039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.442472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:48.442472 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.442472 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:48.442472 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.442472 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.442472 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:48.442472 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.442472 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.443346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.444360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:48.824213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:48.825734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:48.826083 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:48.826299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.827321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:48.827321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.827321 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:48.827321 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.827321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.827321 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:48.827321 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.827321 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.828636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.829871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:48.831151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:48.831300 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:48.832044 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:48.832326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.833185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:48.833185 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.833185 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:48.833185 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.833185 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.833185 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:48.833185 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.833185 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:48.834177 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:48.834723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:48.834723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.834723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:48.834723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.834723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.834723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:48.834723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.834723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:48.835710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.836575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.837326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:48.837326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.837326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:48.864455 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:48.865210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:48.865583 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:48.865841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.866782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:48.866782 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.866782 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:48.866782 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.866782 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.866782 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:48.866782 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.866782 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:48.868366 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.869174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:48.870234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.871142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:48.872151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.872151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:48.872151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:48.872392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:48.872968 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:48.873392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:48.873675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.874983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:48.874983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.874983 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:48.874983 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.874983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.874983 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:48.874983 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.874983 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.876473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:48.877060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:53.405932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:53.408235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:53.444372 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:53.444372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.444937 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:53.444937 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.444937 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:53.444937 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.444937 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.444937 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:53.444937 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.444937 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.445830 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.446733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:53.825234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:53.826382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:53.826644 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:53.826986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.827779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:53.827779 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.827779 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:53.827779 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.827779 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.827779 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:53.827779 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.827779 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.829614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.830315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:53.831098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:53.831306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:53.831831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:53.832202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.832866 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:53.832866 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.832866 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:53.832866 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.832866 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.832866 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:53.832866 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.832866 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:53.833589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:53.834378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:53.834378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.834378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:53.834378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.834378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.834378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:53.834378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.834378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:53.834710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.835348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.836477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:53.836477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.836477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:53.865114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:53.866024 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:53.866981 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:53.867554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.868787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:53.868787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.868787 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:53.868787 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.868787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.868787 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:53.868787 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.868787 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:53.870500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.871128 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:53.872415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.872905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:53.873462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.873462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:53.873462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:53.873582 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:53.874276 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:53.874677 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:53.874993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.875903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:53.875903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.875903 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:53.875903 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.875903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.875903 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:53.875903 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.875903 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.878095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:53.878596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:58.406666 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:58.408649 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:58.446158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:58.446557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.447437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:42:58.447437 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.447437 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:58.447437 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.447437 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.447437 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:58.447437 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.447437 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.449043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.449943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:58.825711 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:58.827145 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:58.827476 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:58.827977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.828651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:58.828651 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.828651 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:58.828651 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.828651 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.828651 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:58.828651 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.828651 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.830579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.831507 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:58.832182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:58.832182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:42:58.832449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:58.832754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:42:58.833577 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.833577 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:58.833577 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.833577 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.833577 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:58.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.833577 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:58.835171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:58.836101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:58.836101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.836101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:58.836101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.836101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.836101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:58.836101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.836101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:42:58.837682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.838270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.838795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:58.838795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.838795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:58.865597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:58.866566 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:58.867374 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:58.867926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.868982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:42:58.868982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.868982 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:58.868982 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.868982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.868982 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:58.868982 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.868982 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:42:58.870778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.871545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:42:58.873023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.873851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:58.875349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.875349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:42:58.875349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:42:58.875349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:42:58.875738 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:58.876096 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:42:58.876340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.877370 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:42:58.877370 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.877370 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:42:58.877370 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.877370 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.877370 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:42:58.877370 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.877370 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.879281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:42:58.880205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:03.407563 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:03.409702 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:03.446114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:03.446760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.447853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:43:03.447853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.447853 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:03.447853 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.447853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.447853 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:03.447853 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.447853 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.448847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.449479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:03.826534 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:03.828277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:03.828596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:03.828772 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.829742 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.832061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.832939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:03.834002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:03.834002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:03.834002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:03.834002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:03.834681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.834681 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:03.834681 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.834681 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.834681 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:03.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.834681 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:03.835399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.836734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:03.837907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.839250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:03.866458 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:03.867137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:03.867804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:03.868133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.868889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:43:03.868889 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.868889 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:03.868889 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.868889 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.868889 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:03.868889 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.868889 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:03.870373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.871130 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:03.872157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.872950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:03.873782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.873782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:03.874121 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:03.875108 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:03.875796 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:03.876271 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:03.876528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.877624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:43:03.877624 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.877624 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:03.877624 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.877624 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.877624 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:03.877624 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.877624 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.879574 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:03.880411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:08.416382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:08.417227 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-99bc6cde-f575-45b5-9fa8-42cca74403f5 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:08.453415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:08.453865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.454976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-99bc6cde-f575-45b5-9fa8-42cca74403f5 None None] Traceback (most recent call last):
Mar 19 18:43:08.454976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.454976 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:08.454976 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.454976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.454976 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:08.454976 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.454976 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-99bc6cde-f575-45b5-9fa8-42cca74403f5 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.456501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.457588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:08.827385 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:08.829161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:08.829532 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:08.829851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.831115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:08.831115 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.831115 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:08.831115 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.831115 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.831115 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:08.831115 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.831115 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.832749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.833627 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:08.834501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:08.834501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:08.834501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:08.834501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.834761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:08.834761 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.834761 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:08.834761 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.834761 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.834761 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:08.834761 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.834761 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:08.835725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:08.836644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:08.836644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.836644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:08.836644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.836644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.836644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:08.836644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.836644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:08.837092 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.837913 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.838791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:08.838791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.838791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:08.866908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:08.867501 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:08.868420 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:08.868817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.869775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:43:08.869775 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.869775 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:08.869775 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.869775 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.869775 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:08.869775 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.869775 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:08.871133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.871855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:08.872973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.873774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:08.874662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.874662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:08.874662 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:08.875518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:08.876613 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:08.876866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:08.877111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.877938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:43:08.877938 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.877938 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:08.877938 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.877938 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.877938 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:08.877938 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.877938 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.879812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:08.880918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:13.460940 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:13.462533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:13.493775 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:13.494377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.495457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:43:13.495457 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.495457 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:13.495457 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.495457 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.495457 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:13.495457 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.495457 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.496905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.497731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:13.828284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:13.829870 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:13.830332 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:13.830618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.831860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:13.831860 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.831860 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:13.831860 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.831860 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.831860 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:13.831860 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.831860 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.834006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.834851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:13.835793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:13.835793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:13.836123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:13.836439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.837477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:13.837477 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.837477 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:13.837477 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.837477 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.837477 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:13.837477 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.837477 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:13.839050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:13.839578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:13.839578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.839578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:13.839578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.839578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.839578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:13.839578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.839578 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:13.840856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.841297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.841785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:13.841785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.841785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:13.867500 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:13.868186 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:13.868823 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:13.869293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.870256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:43:13.870256 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.870256 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:13.870256 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.870256 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.870256 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:13.870256 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.870256 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:13.871585 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.872290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:13.873309 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.874122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:13.875008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.875008 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:13.875294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:13.876201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:13.876697 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:13.877075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:13.877340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.878353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:43:13.878353 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.878353 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:13.878353 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.878353 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.878353 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:13.878353 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.878353 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.879600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:13.880758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:18.462222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:18.464444 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:18.501060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:18.501493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.502598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:43:18.502598 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.502598 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:18.502598 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.502598 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.502598 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:18.502598 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.502598 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.503679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.504544 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:18.829622 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:18.831128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:18.831491 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:18.831736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.832710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:18.832710 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.832710 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:18.832710 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.832710 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.832710 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:18.832710 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.832710 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.835178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.836445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:18.838007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:18.838007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:18.838007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:18.838007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.838673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:18.838673 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.838673 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:18.838673 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.838673 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.838673 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:18.838673 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.838673 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:18.839722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:18.840322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:18.840322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.840322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:18.840322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.840322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.840322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:18.840322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.840322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:18.840808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.841417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.841956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:18.841956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.841956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:18.868361 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:18.869113 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:18.869985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:18.870318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.871151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:43:18.871151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.871151 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:18.871151 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.871151 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.871151 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:18.871151 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.871151 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:18.872521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.873310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:18.873753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.874648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:18.875556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.875556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:18.876104 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:18.876570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:18.877120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:18.877538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:18.877762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.878673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:43:18.878673 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.878673 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:18.878673 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.878673 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.878673 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:18.878673 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.878673 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.881200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:18.881758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:23.463781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:23.497954 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:23.533577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:23.533884 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.534656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Traceback (most recent call last):
Mar 19 18:43:23.534656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.534656 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:23.534656 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.534656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.534656 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:23.534656 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.534656 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.535757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.536206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:23.830430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:23.832228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:23.832607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:23.832863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.833828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:23.833828 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.833828 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:23.833828 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.833828 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.833828 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:23.833828 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.833828 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.834943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.835870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:23.836470 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:23.836667 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:23.837318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:23.837617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.838446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:23.838446 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.838446 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:23.838446 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.838446 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.838446 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:23.838446 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.838446 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:23.839963 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:23.840462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:23.840462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.840462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:23.840462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.840462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.840462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:23.840462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.840462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:23.841988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.842453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.843019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:23.843019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.843019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:23.868915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:23.869669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:23.870623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:23.871233 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.872356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:43:23.872356 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.872356 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:23.872356 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.872356 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.872356 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:23.872356 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.872356 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:23.873828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.874329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:23.875590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.876194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:23.876952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.876952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:23.876952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:23.876952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:23.877657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:23.878156 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:23.878452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.879405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:43:23.879405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.879405 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:23.879405 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.879405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.879405 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:23.879405 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.879405 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.881221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:23.881823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:28.496236 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:28.498016 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9960c777-b46d-4a15-8911-706baed22cdb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:28.534974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:28.535283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.536098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9960c777-b46d-4a15-8911-706baed22cdb None None] Traceback (most recent call last):
Mar 19 18:43:28.536098 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.536098 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:28.536098 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.536098 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.536098 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:28.536098 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.536098 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-9960c777-b46d-4a15-8911-706baed22cdb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.537501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.538421 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:28.831390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:28.833134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:28.833522 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:28.833774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.834865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:28.834865 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.834865 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:28.834865 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.834865 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.834865 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:28.834865 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.834865 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.836900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.838554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:28.839363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:28.839363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:28.839363 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:28.839363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.839677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:28.839677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.839677 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:28.839677 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.839677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.839677 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:28.839677 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.839677 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:28.841347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:28.841803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:28.841803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.841803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:28.841803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.841803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.841803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:28.841803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.841803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:28.842950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.843368 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.843837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:28.843837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.843837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:28.869529 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:28.870254 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:28.871269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:28.871774 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.872948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:43:28.872948 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.872948 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:28.872948 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.872948 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.872948 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:28.872948 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.872948 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:28.873948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.874352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:28.875086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.875480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:28.875952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.875952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:28.877413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:28.878277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:28.878807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:28.879185 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:28.879416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.880460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:43:28.880460 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.880460 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:28.880460 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.880460 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.880460 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:28.880460 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.880460 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.882795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:28.883535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:33.497137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:33.499183 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:34.053620 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:34.055915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:34.064376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:34.068154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:34.068605 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:34.068956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:34.071474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:34.073354 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:34.075076 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:34.075336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.078022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:34.078558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.079235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:34.079503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.080132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:34.080132 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.080132 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:34.080132 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.080132 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.080132 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:34.080132 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.080132 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:34.082386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:34.082779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:34.082779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.082779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:34.082779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.082779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.082779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:34.082779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.082779 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:34.084955 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:34.085560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:34.085560 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.085560 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:34.085560 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.085560 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.085560 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:34.085560 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.085560 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:34.088504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:34.088853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:34.088853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.088853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:34.088853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.088853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.088853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:34.088853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.088853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:34.089101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:34.092569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.092995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.093408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:34.093408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.093408 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:34.095264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.095590 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:34.095939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.095939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:34.095939 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.098026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:34.098026 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.098026 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:34.098026 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.098026 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.098026 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:34.098026 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.098026 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.102126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.102468 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:34.114873 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:34.115258 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.116568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:43:34.116568 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.116568 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:34.116568 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.116568 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.116568 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:34.116568 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.116568 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.117925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.118708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:34.375672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Traceback (most recent call last):
Mar 19 18:43:34.375672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.375672 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:34.375672 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.375672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.375672 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:34.375672 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.375672 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-2a60aa4c-a323-49cc-b2e1-d0bf7a15208c None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:34.377584 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:34.378496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:38.498029 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:38.500284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:38.533903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:38.534440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:38.535445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:43:38.535445 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:38.535445 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:38.535445 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:38.535445 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:38.535445 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:38.535445 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:38.535445 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:38.536540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:38.537615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:39.065185 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:39.066623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:39.066902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:39.067101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.067563 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:39.068002 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:39.068757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:39.070485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:39.071163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:39.071621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:39.072137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.072934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:39.072934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.072934 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:39.072934 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.072934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.072934 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:39.072934 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.072934 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:39.074190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:39.074487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:39.074487 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.074487 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:39.074487 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.074487 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.074487 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:39.074487 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.074487 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:39.076116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:39.076714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.078978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.079460 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:39.080811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.081286 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.081811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:39.081811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.081811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:39.081811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.082020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:39.082134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:39.082279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.082865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:43:39.082865 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.082865 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:39.082865 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.082865 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.082865 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:39.082865 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.082865 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.084490 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:39.085090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:39.085583 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.085583 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:39.085583 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.085583 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.085583 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:39.085583 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.085583 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:39.086562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:39.086997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:39.086997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.086997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:39.086997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.086997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.086997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:39.086997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.086997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:39.088739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:39.089310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:39.089859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:39.089859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:43.498822 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:43.500640 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:43.502741 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:43:43.536060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:43.536332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:43.537093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:43:43.537093 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:43.537093 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:43.537093 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:43.537093 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:43.537093 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:43.537093 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:43.537093 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:43.538200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:43.539061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:44.065924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:44.067597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:44.068023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:44.068206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.069187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:44.069187 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.069187 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:44.069187 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.069187 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.069187 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:44.069187 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.069187 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:44.069749 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.072192 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.072873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:44.073434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:44.073434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:44.073434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:44.073924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.074618 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:44.076264 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:44.076830 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:44.077108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:44.077108 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.077108 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:44.077108 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.077108 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.077108 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:44.077108 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.077108 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:44.077401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:44.079040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:44.079556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:44.081252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.081749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.082303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:44.082303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.082303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:44.082303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:44.082529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:43:44.082529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.082529 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:44.082529 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.082529 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.082529 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:44.082529 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.082529 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:44.082786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:44.084134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:44.084705 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:44.086326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.086801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.087328 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.088133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:44.088611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:48.499788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:48.501670 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:48.540480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:48.540923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:48.541856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:43:48.541856 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:48.541856 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:48.541856 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:48.541856 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:48.541856 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:48.541856 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:48.541856 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:48.543079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:48.544044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:49.066769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:49.068728 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:49.069251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:49.069592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.070753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:49.071427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:49.071928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:49.071928 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.071928 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:49.071928 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.071928 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.071928 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:49.071928 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.071928 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.073783 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.074831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.075910 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:49.076789 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:49.077461 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:49.079465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.079978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.080477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:49.080477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.080477 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:49.080477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:49.080615 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:49.081230 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:49.081912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:49.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.083761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:49.084280 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:49.084613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.085196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:43:49.085196 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.085196 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:49.085196 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.085196 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.085196 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:49.085196 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.085196 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:49.087378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.088038 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:49.089824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.091361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:49.091951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.091951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.092091 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:49.092575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:53.500627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:53.502656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:53.535388 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:53.535827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:53.536736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:43:53.536736 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:53.536736 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:53.536736 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:53.536736 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:53.536736 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:53.536736 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:53.536736 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:53.537704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:53.538643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:54.067750 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:54.069247 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:54.069516 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:54.069637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.070345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:54.070345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.070345 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:54.070345 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.070345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.070345 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:54.070345 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.070345 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.072516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.073563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:54.074384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:54.074384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:54.074384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:54.074560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.075236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:54.075236 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.075236 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:54.075236 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.075236 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.075236 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:54.075236 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.075236 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:54.076439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:54.076946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:54.076946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.076946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:54.076946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.076946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.076946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:54.076946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.076946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:54.078395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.080377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:54.080377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.080377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:54.080377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:54.080377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:54.080624 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:54.081170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:54.081501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.082912 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:54.083316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:54.083564 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:54.083766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.084373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:54.084373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.084373 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:54.084373 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.084373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.084373 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:54.084373 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.084373 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.086680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:54.087131 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:43:54.087629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.087629 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:54.087629 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.087629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.087629 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:54.087629 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.087629 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:54.088138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.088558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:54.089298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:54.089942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:54.090614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:54.090614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:58.501376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:58.503043 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:58.542204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:58.543719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:58.544767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:43:58.544767 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:58.544767 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:58.544767 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:58.544767 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:58.544767 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:58.544767 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:58.544767 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:58.547521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:58.548639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:59.068546 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:59.070796 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:59.071192 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:59.071500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.072722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:59.072722 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.072722 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:59.072722 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.072722 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.072722 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:59.072722 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.072722 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.075208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.075756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:59.076292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:59.076292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:43:59.077035 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:59.077412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.077949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:59.077949 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.077949 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:59.077949 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.077949 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.077949 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:59.077949 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.077949 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:59.079136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:59.080009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:59.080009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.080009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:59.080009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.080009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.080009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:59.080009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.080009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:43:59.080295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.080942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.081663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:59.081663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.081663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:59.081663 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:59.081663 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:59.081917 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:59.082062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.082694 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:43:59.083845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:43:59.083845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:59.083845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:43:59.084062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.084631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:43:59.084631 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.084631 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:59.084631 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.084631 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.084631 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:59.084631 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.084631 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:59.085020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:43:59.085020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.085020 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:43:59.085020 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.085020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.085020 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:43:59.085020 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.085020 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:43:59.086303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:59.086827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:43:59.086827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.086827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:43:59.086827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.086827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.086827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:43:59.086827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.086827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.087840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.088535 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:43:59.089367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:43:59.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:43:59.090582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:43:59.090582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:03.502447 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:03.504765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:03.546828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:03.547087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:03.548048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:44:03.548048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:03.548048 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:03.548048 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:03.548048 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:03.548048 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:03.548048 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:03.548048 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:03.549950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:03.550640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:04.069913 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:04.071479 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:04.071599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:04.071809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.074150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:04.074150 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.074150 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:04.074150 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.074150 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.074150 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:04.074150 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.074150 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.077006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.077704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:04.078545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:04.078545 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:04.078966 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:04.079125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.079640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:04.079640 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.079640 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:04.079640 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.079640 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.079640 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:04.079640 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.079640 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:04.080952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:04.082019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:04.082019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.082019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:04.082019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.082019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.082019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:04.082019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.082019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:04.082513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.084250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:04.084250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.084250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:04.084250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:04.084250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:04.084250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:04.084599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:04.085626 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:04.085873 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.086625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:04.086625 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.086625 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:04.086625 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.086625 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.086625 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:04.086625 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.086625 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:04.087560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:04.088380 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:04.089039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.089526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:04.090055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.090055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:04.090055 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:04.090055 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.090537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:04.090537 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.090537 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:04.090537 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.090537 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.090537 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:04.090537 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.090537 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.091446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:04.092053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:08.503272 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:08.504641 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:08.544098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:08.544624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:08.545852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:08.545852 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:08.545852 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:08.545852 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:08.545852 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:08.545852 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:08.545852 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:08.545852 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:08.547325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:08.547890 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:09.070727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:09.072200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:09.072397 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:09.072523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.073699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:09.073699 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.073699 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:09.073699 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.073699 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.073699 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:09.073699 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.073699 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.075560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.076570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:09.077796 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:09.078288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:09.079250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:09.080067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.080910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:09.080910 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.080910 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:09.080910 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.080910 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.080910 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:09.080910 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.080910 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:09.082427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:09.083445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:09.083445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.083445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:09.083445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.083445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.083445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:09.083445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.083445 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:09.083952 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.084935 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.085924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:09.085924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.085924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:09.085924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:09.085924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:09.085924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:09.085924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:09.086320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:09.086393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.087204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:09.087204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.087204 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:09.087204 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.087204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.087204 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:09.087204 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.087204 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:09.088638 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:09.089607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:09.091413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.091910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:09.092435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.092435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:09.092435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:09.092435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.093049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:09.093049 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.093049 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:09.093049 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.093049 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.093049 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:09.093049 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.093049 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.094298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:09.094838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:13.504107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:13.506094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:13.546369 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:13.546723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:13.547823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:13.547823 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:13.547823 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:13.547823 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:13.547823 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:13.547823 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:13.547823 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:13.547823 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:13.548974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:13.549867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:14.071541 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:14.073022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:14.073492 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:14.073767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.075054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:14.075054 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.075054 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:14.075054 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.075054 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.075054 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:14.075054 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.075054 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.076371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.077433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:14.078427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:14.078573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:14.079161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:14.079634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.080498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:14.080498 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.080498 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:14.080498 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.080498 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.080498 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:14.080498 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.080498 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:14.081304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:14.081863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:14.081863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.081863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:14.081863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.081863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.081863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:14.081863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.081863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:14.082322 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.082782 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:14.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.083315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:14.084812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:14.085210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:14.085513 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:14.085990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.086309 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:14.086762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:14.086762 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.086762 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:14.086762 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.086762 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.086762 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:14.086762 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.086762 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:14.088117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:14.088767 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:14.089925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.090441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:14.091010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.091010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:14.091010 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:14.091010 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:14.091156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.091990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:14.091990 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.091990 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:14.091990 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.091990 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.091990 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:14.091990 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.091990 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.094124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:14.094667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:18.504919 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:18.506804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:18.548509 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:18.548785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:18.549973 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:18.549973 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:18.549973 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:18.549973 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:18.549973 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:18.549973 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:18.549973 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:18.549973 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:18.551006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:18.551759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:19.072554 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:19.074007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:19.074543 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:19.074827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.076117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:19.076117 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.076117 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:19.076117 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.076117 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.076117 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:19.076117 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.076117 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.078190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.079071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:19.079903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:19.079903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:19.079903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:19.079903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.080190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:19.080190 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.080190 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:19.080190 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.080190 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.080190 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:19.080190 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.080190 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:19.081052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:19.081642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:19.081642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.081642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:19.081642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.081642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.081642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:19.081642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.081642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:19.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.082646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.083275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:19.083275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.083275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:19.085379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:19.085772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:19.086163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:19.086430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.086903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:19.086903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.086903 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:19.086903 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.086903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.086903 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:19.086903 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.086903 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:19.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.088179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:19.088926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.089471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:19.090064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.090064 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:19.090064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:19.090064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:19.090064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:19.090257 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:19.090420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.091148 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:19.091148 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.091148 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:19.091148 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.091148 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.091148 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:19.091148 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.091148 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.092160 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:19.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:23.507022 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:23.508884 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:23.542374 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:23.543737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:23.544339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:23.544339 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:23.544339 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:23.544339 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:23.544339 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:23.544339 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:23.544339 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:23.544339 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:23.545633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:23.546065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:24.073510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:24.075157 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:24.075637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:24.075870 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.076853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:24.076853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.076853 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:24.076853 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.076853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.076853 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:24.076853 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.076853 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.078266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.079021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:24.079799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:24.079799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:24.080098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:24.080300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.080740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:24.080740 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.080740 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:24.080740 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.080740 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.080740 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:24.080740 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.080740 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:24.081480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:24.082470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:24.082470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.082470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:24.082470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.082470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.082470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:24.082470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.082470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:24.082979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.083832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.085181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:24.085181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.085181 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:24.085933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:24.086665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:24.087134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:24.087398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.087993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:24.087993 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.087993 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:24.087993 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.087993 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.087993 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:24.087993 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.087993 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:24.088730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.089339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:24.089657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.090225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:24.090799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.090799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:24.090799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:24.090799 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:24.091154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:24.091436 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:24.091640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.092310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:24.092310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.092310 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:24.092310 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.092310 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.092310 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:24.092310 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.092310 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.093912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:28.507914 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:28.509482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:28.547290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:28.547703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:28.549083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:28.549083 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:28.549083 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:28.549083 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:28.549083 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:28.549083 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:28.549083 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:28.549083 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:28.550671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:28.551872 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:29.074462 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:29.076461 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:29.077020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:29.077313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.078415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:29.078415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.078415 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:29.078415 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.078415 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.078415 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:29.078415 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.078415 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.080459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.081611 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:29.082391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:29.082391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:29.082391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:29.082391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.082773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:29.082773 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.082773 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:29.082773 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.082773 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.082773 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:29.082773 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.082773 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:29.083596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:29.084620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:29.084620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.084620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:29.084620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.084620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.084620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:29.084620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.084620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:29.085146 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.085631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.086202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:29.086202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.086202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:29.086565 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:29.087385 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:29.087929 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:29.088245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.089333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:29.089333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.089333 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:29.089333 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.089333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.089333 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:29.089333 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.089333 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:29.090625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.091072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:29.091340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:29.093231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.093725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:29.094239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.094239 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:29.094239 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:29.094493 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:29.094728 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:29.094922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.095473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:29.095473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.095473 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:29.095473 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.095473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.095473 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:29.095473 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.095473 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.096773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:29.097287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:33.509119 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:33.511237 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:33.547622 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:33.547951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:33.548709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:33.548709 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:33.548709 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:33.548709 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:33.548709 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:33.548709 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:33.548709 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:33.548709 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:33.550016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:33.551051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:34.075836 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:34.077148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:34.077502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:34.077685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.078454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:34.078454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.078454 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:34.078454 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.078454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.078454 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:34.078454 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.078454 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.079667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.080487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:34.081583 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:34.081906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:34.082291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:34.082539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.083147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:34.083147 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.083147 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:34.083147 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.083147 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.083147 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:34.083147 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.083147 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:34.084101 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.087213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:34.087955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:34.088630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:34.090667 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:34.092010 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:34.092010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.092388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:34.092388 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.092388 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:34.092388 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.092388 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.092388 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:34.092388 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.092388 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:34.093365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.093813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:34.095646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.096023 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:34.096386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.096386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:34.096386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:34.096795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:34.097468 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:34.097699 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:34.097951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.098660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:34.098660 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.098660 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:34.098660 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.098660 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.098660 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:34.098660 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.098660 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.099731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:34.100116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:37.990650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:38.002785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:389}}
Mar 19 18:44:38.002986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=103900) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:370}}
Mar 19 18:44:38.003092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Fixing resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:44:38.045970 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, resource={'id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'name': 'private', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb', 'bee598c2-f62b-4321-b08d-23e3a7c6ccb9'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:09:27Z', 'updated_at': '2026-03-19T18:09:31Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 29513}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.046415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.047105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b55270e8-5359-4f54-8804-fcbd7769eee3, external_ids_update=None, columns={'tag': 29513}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.047693 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.048599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Traceback (most recent call last):
Mar 19 18:44:38.048599 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.048599 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:38.048599 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.048599 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.048599 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:38.048599 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.048599 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Failed to fix resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.050722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.051645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.052272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:44:38.052272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.052272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:44:38.052272 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Fixing resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:44:38.090028 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, resource={'id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'name': 'public', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['7888df47-ce34-4091-9e08-c1c5949f53a2', 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-03-19T18:09:34Z', 'updated_at': '2026-03-19T18:09:44Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.090612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.091451 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-20b6196a-9254-4b37-a645-8253845242a7, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.091799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.092904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Traceback (most recent call last):
Mar 19 18:44:38.092904 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.092904 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:38.092904 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.092904 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.092904 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:38.092904 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.092904 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Failed to fix resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.094311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.095034 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.095665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:44:38.095665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.095665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:44:38.095665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Fixing resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:44:38.125070 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-420e2995-aa57-46db-9651-85807f50bcb9, resource={'id': '420e2995-aa57-46db-9651-85807f50bcb9', 'name': 'admin_net', 'tenant_id': '1ed140779dbc462d89fd3e785886b2bb', 'project_id': '1ed140779dbc462d89fd3e785886b2bb', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['388b450f-f17e-4671-94e9-9f169d754be7'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:13:33Z', 'updated_at': '2026-03-19T18:13:34Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 28229}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.125946 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-420e2995-aa57-46db-9651-85807f50bcb9, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.126328 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-07b4049d-60f0-4621-a8e7-5dcac93308be, external_ids_update=None, columns={'tag': 28229}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.126431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.127466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Traceback (most recent call last):
Mar 19 18:44:38.127466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.127466 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:38.127466 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.127466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.127466 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:38.127466 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.127466 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Failed to fix resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.128717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.129471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.130204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:44:38.130204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.130204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:44:38.130204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Fixing resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:44:38.157123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, resource={'id': '4d64a793-ee68-4a18-b938-f55304c6fcf6', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0bc68cc0-48dc-4abe-bbac-0a4f654efb2e'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:14:20Z', 'updated_at': '2026-03-19T18:14:21Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 59295}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.158653 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-42ff4b0a-bf0a-4937-bf0f-c8b42f68f267, external_ids_update=None, columns={'tag': 59295}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.158832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.159697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Traceback (most recent call last):
Mar 19 18:44:38.159697 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.159697 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:38.159697 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.159697 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.159697 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:38.159697 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.159697 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Failed to fix resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.161298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.162125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.162868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:44:38.162868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.162868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:44:38.162868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Fixing resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:44:38.247965 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, resource={'id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'enable_snat': True}, 'gw_port_id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-1id6n', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'ip_address': '172.24.5.52', 'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, {'ip_address': '2001:db8::2c3', 'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:25Z', 'revision_number': 3, 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89'}, resource_type=routers, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.248420 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.248767 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.249034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.249340 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.250747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Traceback (most recent call last):
Mar 19 18:44:38.250747 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.250747 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:38.250747 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.250747 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.250747 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:38.250747 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.250747 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:38.251075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Unable to update router cf5e0251-94c8-4bce-b873-648b8cc72809. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Failed to fix resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Mar 19 18:44:38.253295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:44:38.253703 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:44:38.254144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Fixing resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:44:38.364128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, resource={'id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'name': '', 'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'project_id': '', 'mac_address': 'fa:16:3e:11:31:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000160124', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:24Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.364629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::2c3/64', '172.24.5.52/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.365213 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=f319bf7e-5d34-47af-b620-bec8597c3819, lrouter_port=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.365588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.366654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Traceback (most recent call last):
Mar 19 18:44:38.366654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.366654 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:38.366654 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.366654 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.366654 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:38.366654 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.366654 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Failed to fix resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.367729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.368383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.369280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:44:38.369280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.369280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:44:38.369280 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5821017e-3316-4cd4-8371-1b7ed4aeb38e None None] Maintenance task: Synchronization completed (took 0.36 seconds)
Mar 19 18:44:38.510009 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:38.511924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:38.546311 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:38.546769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.547802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:38.547802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.547802 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:38.547802 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.547802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.547802 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:38.547802 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.547802 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.549061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:38.549524 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:39.076327 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:39.078034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:39.078509 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:39.078871 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.080112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:39.080112 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.080112 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:39.080112 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.080112 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.080112 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:39.080112 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.080112 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.082061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.082680 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:39.083242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:39.083242 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:39.083533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:39.083863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.084677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:39.084677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.084677 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:39.084677 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.084677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.084677 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:39.084677 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.084677 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:39.085446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:39.085996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:39.085996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.085996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:39.085996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.085996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.085996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:39.085996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.085996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:39.086392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.086851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.087367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:39.087367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.087367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:39.090827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:39.091649 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:39.092390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:39.092678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.093423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:39.093423 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.093423 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:39.093423 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.093423 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.093423 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:39.093423 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.093423 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:39.095082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.095512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:39.096510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.096996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:39.097511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.097511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:39.097511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:39.097511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:39.097672 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:39.097971 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:39.098159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.098994 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:39.098994 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.098994 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:39.098994 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.098994 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.098994 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:39.098994 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.098994 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.100003 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:39.100609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:43.510779 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:43.513324 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:43.515798 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=434 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:44:43.549135 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:43.549530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:43.550528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:43.550528 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:43.550528 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:43.550528 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:43.550528 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:43.550528 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:43.550528 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:43.550528 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:43.552200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:43.553108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:44.077166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:44.078664 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:44.079100 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:44.079352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.080520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:44.080520 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.080520 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:44.080520 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.080520 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.080520 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:44.080520 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.080520 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.082469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.083292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:44.084084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:44.084084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:44.084387 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:44.084692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.085487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:44.085487 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.085487 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:44.085487 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.085487 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.085487 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:44.085487 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.085487 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:44.086944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:44.087383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:44.087383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.087383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:44.087383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.087383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.087383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:44.087383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.087383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:44.088651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.089107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.089623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:44.089623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.089623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:44.091328 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:44.092135 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:44.092668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:44.093078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.093668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:44.093668 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.093668 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:44.093668 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.093668 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.093668 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:44.093668 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.093668 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:44.095352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.096082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:44.097308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.098095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:44.099031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.099031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:44.099031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:44.099031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:44.099031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:44.099031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:44.099383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.100089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:44.100089 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.100089 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:44.100089 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.100089 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.100089 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:44.100089 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.100089 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.101178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:44.102059 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:48.512170 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:48.513989 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:48.557101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:48.557470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:48.558501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:48.558501 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:48.558501 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:48.558501 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:48.558501 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:48.558501 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:48.558501 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:48.558501 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:48.559587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:48.560288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:49.078011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:49.079482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:49.080310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:49.080310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.081287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:49.081287 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.081287 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:49.081287 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.081287 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.081287 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:49.081287 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.081287 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.083248 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.083778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:49.084393 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:49.084393 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:49.084393 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:49.084679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.085193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:49.085193 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.085193 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:49.085193 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.085193 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.085193 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:49.085193 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.085193 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:49.086226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:49.086725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:49.086725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.086725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:49.086725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.086725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.086725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:49.086725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.086725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:49.087707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.088225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.088838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:49.088838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.088838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:49.091753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:49.092283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:49.092515 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:49.092747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.093305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:49.093305 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.093305 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:49.093305 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.093305 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.093305 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:49.093305 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.093305 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:49.094221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.094681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:49.095537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.096271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:49.097013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.097013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:49.098348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:49.099187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:49.099600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:49.099815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:49.099991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.100686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:49.100686 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.100686 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:49.100686 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.100686 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.100686 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:49.100686 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.100686 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.102833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:49.103430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:53.513024 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:53.514583 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:53.549704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:53.550684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:53.551656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:53.551656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:53.551656 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:53.551656 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:53.551656 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:53.551656 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:53.551656 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:53.551656 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:53.553575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:53.554587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:54.078803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:54.080161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:54.081027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:54.081027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.081562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:54.081562 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.081562 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:54.081562 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.081562 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.081562 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:54.081562 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.081562 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.083269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.084314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:54.085144 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:54.086177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:54.086177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:54.086382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.086730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:54.086730 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.086730 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:54.086730 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.086730 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.086730 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:54.086730 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.086730 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:54.088641 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:54.089203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:54.089203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.089203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:54.089203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.089203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.089203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:54.089203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.089203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:54.089496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.089950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.090434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:54.090434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.090434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:54.092163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:54.093196 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:54.093596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:54.094015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.094687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:54.094687 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.094687 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:54.094687 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.094687 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.094687 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:54.094687 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.094687 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:54.095497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.096025 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:54.096547 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.097147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:54.097651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.097651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:54.099967 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:54.099967 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:54.100325 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:54.100518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:54.100724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.101448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:54.101448 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.101448 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:54.101448 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.101448 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.101448 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:54.101448 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.101448 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.102465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:54.103254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:58.513676 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:58.515292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:58.552858 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:58.553236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:58.554068 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:44:58.554068 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:58.554068 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:58.554068 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:58.554068 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:58.554068 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:58.554068 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:58.554068 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:58.555098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:58.556027 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:59.079769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:59.081465 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:59.082107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:59.082107 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.085558 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:59.086715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.087639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.087639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:59.087639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.087639 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:59.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:59.089200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:44:59.089643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:59.089869 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.090453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:59.090453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.090453 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:59.090453 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.090453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.090453 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:59.090453 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.090453 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:59.091357 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:59.091947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:59.091947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.091947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:59.091947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.091947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.091947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:59.091947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.091947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:44:59.092457 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.092944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.093407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:59.093407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.093407 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:59.093407 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:59.093802 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:59.094310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:59.094659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.095454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:44:59.095454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.095454 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:59.095454 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.095454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.095454 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:59.095454 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.095454 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:44:59.096569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.097006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:44:59.097770 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.098235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:59.098707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.098707 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:44:59.099665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:44:59.100187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:44:59.100961 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:59.101299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:44:59.101586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.102436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:44:59.102436 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.102436 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:44:59.102436 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.102436 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.102436 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:44:59.102436 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.102436 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.104791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:44:59.105304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:03.514577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:03.516502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:03.552701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:03.553134 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:03.554050 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:45:03.554050 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:03.554050 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:03.554050 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:03.554050 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:03.554050 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:03.554050 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:03.554050 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:03.555427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:03.556095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:04.080525 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:04.082551 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:04.083012 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:04.083274 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.084383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:04.084383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.084383 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:04.084383 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.084383 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.084383 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:04.084383 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.084383 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.085975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.087265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:04.089404 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:04.090120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:04.090639 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:04.090874 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.091519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:04.091519 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.091519 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:04.091519 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.091519 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.091519 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:04.091519 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.091519 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:04.093120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:04.093834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:04.093834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.093834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:04.093834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.093834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.093834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:04.093834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.093834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:04.095007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.095491 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.096051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:04.096051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.096051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:04.096051 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:04.097347 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:04.097989 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:04.098221 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.098836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:04.098836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.098836 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:04.098836 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.098836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.098836 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:04.098836 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.098836 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:04.099736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.100188 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:04.101063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.101651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:04.102195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.102195 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:04.102195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:04.102195 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:04.102577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:04.102807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:04.102983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.103539 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:04.103539 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.103539 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:04.103539 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.103539 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.103539 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:04.103539 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.103539 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.105531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:04.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:08.515529 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:08.517410 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:08.549599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:08.550236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:08.551374 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:45:08.551374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:08.551374 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:08.551374 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:08.551374 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:08.551374 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:08.551374 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:08.551374 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:08.552438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:08.552867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:09.081446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:09.083131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:09.083449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:09.083698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.084644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:09.084644 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.084644 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:09.084644 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.084644 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.084644 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:09.084644 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.084644 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.087016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.088573 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:09.089967 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:09.090662 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:09.092115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:09.092299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.093210 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:09.093210 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.093210 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:09.093210 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.093210 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.093210 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:09.093210 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.093210 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:09.093965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:09.094562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:09.094562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.094562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:09.094562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.094562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.094562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:09.094562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.094562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:09.094990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.095480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.096112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:09.096112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.096112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:09.096112 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:09.096527 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:09.097005 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:09.097264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.097965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:09.097965 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.097965 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:09.097965 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.097965 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.097965 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:09.097965 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.097965 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:09.099173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.099732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:09.100415 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.100974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:09.101496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.101496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:09.101805 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:09.102572 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:09.103255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:09.103473 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:09.103647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.104685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:09.104685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.104685 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:09.104685 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.104685 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.104685 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:09.104685 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.104685 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.106694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:09.107270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:13.516163 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:13.518330 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:13.562915 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:13.563186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:13.563959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:45:13.563959 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:13.563959 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:13.563959 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:13.563959 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:13.563959 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:13.563959 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:13.563959 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:13.565086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:13.565661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:14.082173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:14.083584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:14.084037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:14.084300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.085281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:14.085281 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.085281 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:14.085281 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.085281 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.085281 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:14.085281 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.085281 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.086559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.087513 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:14.090373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:14.090911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:14.091520 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:14.091856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.092657 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:14.092657 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.092657 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:14.092657 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.092657 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.092657 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:14.092657 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.092657 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:14.094133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:14.094694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:14.094694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.094694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:14.094694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.094694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.094694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:14.094694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.094694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:14.095708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.096583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.097169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:14.097169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.097169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:14.097169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:14.097306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:14.097904 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:14.098312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.099149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:14.099149 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.099149 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:14.099149 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.099149 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.099149 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:14.099149 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.099149 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:14.100640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.101153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:14.102554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.103367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:14.103843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.103843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:14.103843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:14.103843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:14.104356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:14.104720 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:14.105066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.105980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:14.105980 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.105980 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:14.105980 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.105980 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.105980 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:14.105980 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.105980 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.107323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:14.107831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:18.517193 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:18.518800 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:18.561541 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:18.561991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:18.563103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:45:18.563103 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:18.563103 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:18.563103 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:18.563103 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:18.563103 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:18.563103 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:18.563103 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:18.564141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:18.565108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:19.082977 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:19.084750 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:19.085286 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:19.085454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.086704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:19.086704 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.086704 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:19.086704 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.086704 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.086704 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:19.086704 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.086704 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.088484 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.089561 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:19.090997 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:19.091409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:19.091890 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:19.092180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.092916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:19.092916 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.092916 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:19.092916 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.092916 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.092916 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:19.092916 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.092916 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:19.093801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:19.094395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:19.094395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.094395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:19.094395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.094395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.094395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:19.094395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.094395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:19.094823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.095338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.095975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:19.095975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.095975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:19.097066 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:19.097445 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:19.097964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:19.098372 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.099196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:19.099196 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.099196 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:19.099196 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.099196 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.099196 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:19.099196 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.099196 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:19.100057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.100746 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:19.101308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.101940 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:19.102508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.102508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:19.103579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:19.104221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:19.104704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:19.105095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:19.105256 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.105859 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:19.105859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.105859 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:19.105859 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.105859 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.105859 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:19.105859 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.105859 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.107294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:19.107814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:23.517902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:23.518869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:23.545510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:23.545925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:23.547193 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:45:23.547193 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:23.547193 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:23.547193 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:23.547193 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:23.547193 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:23.547193 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:23.547193 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:23.548621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:23.549444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:24.083562 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:24.084783 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:24.085190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:24.085465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.087304 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:24.087914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.088467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.088467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:24.088467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.088467 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:24.091540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:24.091924 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:24.092487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:24.092748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.093316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:24.093316 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.093316 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:24.093316 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.093316 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.093316 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:24.093316 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.093316 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:24.093926 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:24.094305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:24.094305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.094305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:24.094305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.094305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.094305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:24.094305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.094305 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:24.094648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.095021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.095384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:24.095384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.095384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:24.097377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:24.097704 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:24.098045 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:24.098303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.098778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:24.098778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.098778 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:24.098778 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.098778 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.098778 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:24.098778 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.098778 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:24.099348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.099818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:24.100169 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.100525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:24.101062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.101062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:24.104047 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:24.104631 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:24.105389 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:24.106530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:24.106530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.106799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:24.106799 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.106799 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:24.106799 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.106799 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.106799 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:24.106799 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.106799 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.108015 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:24.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:28.518441 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:28.520196 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:28.559288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:28.559567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:28.560610 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:45:28.560610 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:28.560610 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:28.560610 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:28.560610 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:28.560610 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:28.560610 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:28.560610 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:28.561730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:28.562120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:29.084768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:29.085584 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:29.086087 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:29.086797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.087466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:29.087466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.087466 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:29.087466 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.087466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.087466 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:29.087466 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.087466 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.088481 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.088972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:29.091999 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:29.092287 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:29.092964 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:29.093471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.094110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:29.094110 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.094110 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:29.094110 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.094110 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.094110 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:29.094110 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.094110 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:29.094702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.096013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:29.096450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.096959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:29.097763 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:29.098069 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:29.098778 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:29.099449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.100298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:29.100298 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.100298 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:29.100298 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.100298 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.100298 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:29.100298 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.100298 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:29.101002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.101428 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:29.101768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.102619 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:29.104093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.104093 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:29.104515 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:29.105190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:29.105933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:29.106324 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:29.106564 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.108257 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:29.108257 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.108257 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:29.108257 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.108257 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.108257 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:29.108257 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.108257 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.109236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:29.109936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:33.520987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:33.521985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:33.561109 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:33.561504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:33.562356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:45:33.562356 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:33.562356 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:33.562356 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:33.562356 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:33.562356 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:33.562356 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:33.562356 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:33.563595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:33.564537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:34.085008 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:34.086037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:34.086346 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:34.086512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.087444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:34.087444 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.087444 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:34.087444 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.087444 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.087444 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:34.087444 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.087444 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.088736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.089812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:34.092648 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:34.093241 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:34.093786 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:34.094051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.094731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:34.094731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.094731 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:34.094731 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.094731 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.094731 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:34.094731 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.094731 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:34.095629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:34.096623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:34.096623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.096623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:34.096623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.096623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.096623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:34.096623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.096623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:34.097024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.097504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.098040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:34.098040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.098040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:34.098947 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:34.098947 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:34.100051 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:34.100335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.101996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.103030 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:34.103453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.104009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:34.104557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.104557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:34.104942 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:34.105797 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:34.106529 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:34.106781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:34.106969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.107659 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:34.107659 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.107659 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:34.107659 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.107659 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.107659 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:34.107659 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.107659 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.109471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:34.110203 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:38.521691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:38.523171 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:38.565038 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:38.565413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:38.566365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:45:38.566365 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:38.566365 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:38.566365 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:38.566365 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:38.566365 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:38.566365 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:38.566365 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:38.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:38.568197 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:39.085977 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:39.087576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:39.087864 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:39.088110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.089056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:39.089056 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.089056 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:39.089056 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.089056 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.089056 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:39.089056 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.089056 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.091042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.091694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:39.093224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:39.093854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:39.094402 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:39.094690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.095395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:39.095395 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.095395 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:39.095395 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.095395 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.095395 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:39.095395 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.095395 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:39.096466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:39.097033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:39.097033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.097033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:39.097033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.097033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.097033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:39.097033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.097033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:39.097711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.098250 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.098793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:39.098793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.098793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:39.098793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:39.099431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:39.099997 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:39.100280 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.100862 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:39.100862 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.100862 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:39.100862 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.100862 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.100862 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:39.100862 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.100862 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:39.102259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.102730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:39.103945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.104447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:39.104996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.104996 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:39.105387 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:39.105818 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:39.106202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:39.106440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:39.106629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.107319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:39.107319 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.107319 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:39.107319 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.107319 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.107319 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:39.107319 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.107319 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.108824 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:39.109401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:43.522342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:43.524190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:43.526373 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:45:43.572277 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:43.572721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:43.573835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Traceback (most recent call last):
Mar 19 18:45:43.573835 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:43.573835 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:43.573835 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:43.573835 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:43.573835 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:43.573835 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:43.573835 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-78397280-7e29-4d3e-a5ec-eccd8dd38ddb None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:43.574792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:43.575710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:44.086862 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:44.087897 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:44.088181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:44.088371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.089106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:44.089106 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.089106 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:44.089106 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.089106 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.089106 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:44.089106 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.089106 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.090275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.091218 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:44.093629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:44.093903 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:44.094319 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:44.094563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.095379 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:44.095379 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.095379 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:44.095379 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.095379 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.095379 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:44.095379 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.095379 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:44.096413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:44.096953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:44.096953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.096953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:44.096953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.096953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.096953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:44.096953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.096953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:44.097541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.098004 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.098480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:44.098480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.098480 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:44.099233 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:44.099929 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:44.100502 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:44.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.101549 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:44.101549 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.101549 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:44.101549 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.101549 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.101549 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:44.101549 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.101549 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:44.102361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.102865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:44.103462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.103918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:44.104367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.104367 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:44.105691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:44.106437 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:44.106869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:44.107150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:44.107312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.107887 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:44.107887 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.107887 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:44.107887 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.107887 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.107887 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:44.107887 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.107887 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.109868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:44.110329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:48.523212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:48.525320 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:48.564972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:48.565224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:48.565826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:45:48.565826 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:48.565826 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:48.565826 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:48.565826 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:48.565826 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:48.565826 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:48.565826 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:48.566629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:48.567533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:49.087431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:49.088768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:49.089177 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:49.089378 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.090308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:49.090308 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.090308 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:49.090308 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.090308 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.090308 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:49.090308 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.090308 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.093065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.093899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:49.094706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:49.094706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:49.094706 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:49.095010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.095730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:49.095730 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.095730 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:49.095730 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.095730 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.095730 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:49.095730 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.095730 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:49.096565 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:49.097115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:49.097115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.097115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:49.097115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.097115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.097115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:49.097115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.097115 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:49.097551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.098049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.098583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:49.098583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.098583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:49.099788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:49.100120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:49.100571 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:49.100959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.101698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:49.101698 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.101698 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:49.101698 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.101698 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.101698 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:49.101698 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.101698 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:49.103053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.103506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:49.104446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.104957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:49.105462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.105462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:49.106638 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:49.107322 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:49.107753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:49.108019 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:49.108186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.108706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:49.108706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.108706 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:49.108706 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.108706 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.108706 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:49.108706 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.108706 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.109819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:49.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:53.524295 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:53.526570 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:53.573058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:53.573717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:53.574811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:45:53.574811 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:53.574811 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:53.574811 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:53.574811 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:53.574811 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:53.574811 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:53.574811 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:53.576419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:53.577061 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:54.088243 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:54.089816 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:54.090249 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:54.090570 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.091471 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:54.091471 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.091471 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:54.091471 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.091471 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.091471 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:54.091471 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.091471 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.093212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.093744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:54.094523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:54.095000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:54.095474 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:54.095786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.096509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:54.096509 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.096509 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:54.096509 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.096509 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.096509 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:54.096509 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.096509 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:54.097675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:54.098335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:54.098335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.098335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:54.098335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.098335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.098335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:54.098335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.098335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:54.099312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.099775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.100289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:54.100289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.100289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:54.100289 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:54.100603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:54.100936 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:54.101157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.101666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:54.101666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.101666 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:54.101666 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.101666 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.101666 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:54.101666 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.101666 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:54.102992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.103455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:54.104914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.105730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:54.106605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.106605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:54.107318 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:54.107866 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:54.108303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:54.108668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:54.108982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.109720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:54.109720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.109720 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:54.109720 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.109720 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.109720 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:54.109720 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.109720 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.111380 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:54.112080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:58.524917 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:58.527001 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:58.563590 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:58.563821 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:58.564592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:45:58.564592 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:58.564592 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:58.564592 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:58.564592 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:58.564592 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:58.564592 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:58.564592 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:58.565436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:58.566293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:59.089080 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:59.090737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:59.092106 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:59.092375 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.093663 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:59.093663 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.093663 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:59.093663 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.093663 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.093663 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:59.093663 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.093663 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.095522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.096537 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:59.097813 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:59.097813 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:45:59.097813 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:59.097813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.098404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:59.098404 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.098404 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:59.098404 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.098404 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.098404 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:59.098404 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.098404 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:59.099833 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:59.100596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:59.100596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.100596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:59.100596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.100596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.100596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:59.100596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.100596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:45:59.101671 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.102187 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.102760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:59.102760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.102760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:59.102760 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:59.102760 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:59.103231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:59.103589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.104138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:45:59.104138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.104138 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:59.104138 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.104138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.104138 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:59.104138 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.104138 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:45:59.104825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.105631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:45:59.106046 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.106502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:59.107070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.107070 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:45:59.107695 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:45:59.107966 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:45:59.108231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:59.108456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:45:59.108616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.109156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:45:59.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:45:59.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:45:59.109156 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.109156 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.110075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:45:59.110761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:03.526306 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:03.527932 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:03.570180 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:03.570442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:03.571582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:03.571582 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:03.571582 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:03.571582 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:03.571582 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:03.571582 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:03.571582 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:03.571582 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:03.572803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:03.573419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:04.089921 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:04.091345 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:04.091612 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:04.091843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.092722 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:04.092722 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.092722 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:04.092722 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.092722 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.092722 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:04.092722 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.092722 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.094778 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.096495 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.097956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:04.098690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.099760 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:04.100917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.102000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:04.102577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:04.102900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:04.103164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:04.103499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.103972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:04.103972 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.103972 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:04.103972 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.103972 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.103972 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:04.103972 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.103972 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:04.104677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.105200 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:04.105710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.106308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:04.106811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.106811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:04.108136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:04.108659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:04.109167 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:04.109511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:04.109762 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.110543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:04.110543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.110543 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:04.110543 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.110543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.110543 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:04.110543 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.110543 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.112178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:04.112801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:08.526802 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:08.528404 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:08.575228 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:08.575228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:08.576284 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:08.576284 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:08.576284 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:08.576284 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:08.576284 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:08.576284 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:08.576284 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:08.576284 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:08.577815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:08.578371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:09.090579 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:09.092013 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:09.092483 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:09.092793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.093817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:09.093817 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.093817 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:09.093817 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.093817 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.093817 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:09.093817 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.093817 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.095814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.096626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:09.097464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:09.097464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:09.098133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:09.098427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.099321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:09.099321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.099321 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:09.099321 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.099321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.099321 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:09.099321 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.099321 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:09.100831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:09.101606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:09.101606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.101606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:09.101606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.101606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.101606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:09.101606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.101606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:09.102617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.103066 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.103669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:09.103669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.103669 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:09.103669 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:09.103793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:09.104223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:09.104475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.105155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:09.105155 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.105155 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:09.105155 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.105155 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.105155 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:09.105155 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.105155 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:09.106764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.107224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:09.108868 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.109358 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:09.109867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.109867 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:09.109867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:09.109867 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:09.110272 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:09.110599 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:09.110844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.111629 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:09.111629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.111629 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:09.111629 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.111629 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.111629 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:09.111629 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.111629 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.113098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:09.113642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:13.527382 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:13.529209 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:13.565842 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:13.566142 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:13.566914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:13.566914 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:13.566914 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:13.566914 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:13.566914 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:13.566914 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:13.566914 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:13.566914 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:13.567903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:13.569175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:14.091731 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:14.093235 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:14.093427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:14.093634 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.094291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:14.094291 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.094291 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:14.094291 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.094291 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.094291 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:14.094291 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.094291 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.095725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.096505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:14.097221 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:14.097938 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:14.098527 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:14.098731 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.099347 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:14.099347 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.099347 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:14.099347 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.099347 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.099347 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:14.099347 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.099347 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:14.100729 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:14.101277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:14.101277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.101277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:14.101277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.101277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.101277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:14.101277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.101277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:14.102339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.102920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.103511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:14.103511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.103511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:14.103511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:14.103985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:14.104520 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:14.104788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.105503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:14.105503 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.105503 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:14.105503 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.105503 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.105503 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:14.105503 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.105503 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:14.106447 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.107105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:14.107889 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.108533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:14.109139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.109139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:14.109720 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:14.110182 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:14.110679 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:14.111091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:14.111454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.112007 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:14.112007 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.112007 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:14.112007 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.112007 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.112007 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:14.112007 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.112007 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.113021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:14.113525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:18.528383 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:18.530134 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:18.567556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:18.568048 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:18.569123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:18.569123 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:18.569123 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:18.569123 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:18.569123 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:18.569123 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:18.569123 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:18.569123 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:18.570120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:18.571052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:19.092803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:19.093869 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:19.094116 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:19.094277 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.094905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:19.094905 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.094905 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:19.094905 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.094905 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.094905 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:19.094905 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.094905 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.096018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.096817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:19.097678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:19.098031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:19.098334 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:19.098536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.099020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:19.099020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.099020 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:19.099020 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.099020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.099020 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:19.099020 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.099020 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:19.100227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:19.101047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:19.101047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.101047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:19.101047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.101047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.101047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:19.101047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.101047 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:19.101818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.102283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.102793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:19.102793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.102793 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:19.103829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:19.104540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:19.105046 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:19.105291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.105983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:19.105983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.105983 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:19.105983 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.105983 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.105983 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:19.105983 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.105983 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:19.107475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.107934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:19.109327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.109841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:19.110384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.110384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:19.110384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:19.110384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:19.110534 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:19.110758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:19.110930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.111359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:19.111359 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.111359 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:19.111359 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.111359 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.111359 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:19.111359 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.111359 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.112307 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:19.112813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:23.529274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:23.530856 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:23.575922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:23.576345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:23.577502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:23.577502 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:23.577502 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:23.577502 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:23.577502 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:23.577502 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:23.577502 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:23.577502 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:23.578763 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:23.579673 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:24.093471 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:24.095408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:24.095795 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:24.096090 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.097194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:24.097194 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.097194 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:24.097194 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.097194 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.097194 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:24.097194 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.097194 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:24.098918 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.099823 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:24.100681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:24.100681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:24.100681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:24.100681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.101184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:24.101184 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.101184 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:24.101184 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.101184 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.101184 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:24.101184 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.101184 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:24.102269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:24.102805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:24.102805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.102805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:24.102805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.102805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.102805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:24.102805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.102805 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:24.103344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.103946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.104556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:24.104556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.104556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:24.104556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:24.104556 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:24.105091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:24.105320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.105979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:24.105979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.105979 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:24.105979 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.105979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.105979 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:24.105979 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.105979 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:24.107336 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:24.107818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:24.107818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.107818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:24.107818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.107818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.107818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:24.107818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.107818 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:24.109037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.109615 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:24.110222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.110222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:24.110616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:24.111596 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:24.111987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:24.112204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:24.112363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.113198 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:24.113198 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.113198 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:24.113198 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.113198 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.113198 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:24.113198 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.113198 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.115082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:24.115903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:28.529951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:28.531742 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:28.573423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:28.574069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:28.575430 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:28.575430 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:28.575430 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:28.575430 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:28.575430 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:28.575430 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:28.575430 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:28.575430 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:28.576768 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:28.577326 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:29.094328 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:29.095712 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:29.096084 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:29.096287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.097166 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:29.097166 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.097166 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:29.097166 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.097166 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.097166 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:29.097166 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.097166 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:29.098451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.099327 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:29.100290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:29.100290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:29.100290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:29.100438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.100910 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:29.100910 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.100910 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:29.100910 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.100910 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.100910 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:29.100910 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.100910 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:29.101668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:29.102108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:29.102108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.102108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:29.102108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.102108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.102108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:29.102108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.102108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:29.102597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.103102 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.103586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:29.103586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.103586 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:29.104544 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:29.105187 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:29.105600 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:29.105799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.106268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:29.106268 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.106268 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:29.106268 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.106268 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.106268 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:29.106268 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.106268 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:29.107185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:29.107626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:29.107626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.107626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:29.107626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.107626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.107626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:29.107626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.107626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:29.108123 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.108589 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:29.109389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.109389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:29.111074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:29.111580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:29.111854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:29.112060 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:29.112194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.113052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:29.113052 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.113052 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:29.113052 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.113052 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.113052 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:29.113052 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.113052 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.114851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:29.115354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:33.530788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:33.532428 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:33.563161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:33.563515 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:33.564519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:33.564519 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:33.564519 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:33.564519 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:33.564519 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:33.564519 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:33.564519 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:33.564519 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:33.565423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:33.566081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:34.095115 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:34.096663 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:34.096992 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:34.097266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.098297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:34.098297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.098297 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:34.098297 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.098297 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.098297 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:34.098297 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.098297 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:34.100352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.101209 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:34.102294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:34.102294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:34.102294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:34.102294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.102777 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:34.102777 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.102777 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:34.102777 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.102777 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.102777 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:34.102777 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.102777 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:34.103625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.104493 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:34.105300 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:34.106150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.106791 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:34.107811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:34.108394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:34.108394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.108394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:34.108394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.108394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.108394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:34.108394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.108394 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:34.109183 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.109675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:34.110236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.110236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:34.111543 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:34.112257 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:34.112807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:34.113226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:34.113489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.114290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:34.114290 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.114290 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:34.114290 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.114290 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.114290 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:34.114290 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.114290 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.115685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:34.116186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:38.531857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:38.532970 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:38.568937 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:38.569844 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:38.571266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:38.571266 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:38.571266 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:38.571266 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:38.571266 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:38.571266 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:38.571266 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:38.571266 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:38.572171 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:38.572613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:39.095978 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:39.097272 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:39.097479 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:39.097577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.098371 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:39.098371 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.098371 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:39.098371 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.098371 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.098371 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:39.098371 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.098371 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:39.100133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.101194 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:39.102601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:39.102601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:39.102601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:39.102601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.103332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:39.103332 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.103332 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:39.103332 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.103332 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.103332 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:39.103332 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.103332 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:39.104062 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.105383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:39.106625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:39.108173 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.109140 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.110360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.110813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:39.111376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.111964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.111964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:39.111964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.111964 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:39.112090 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:39.112419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:39.112770 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:39.113003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:39.113145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.113690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:39.113690 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.113690 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:39.113690 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.113690 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.113690 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:39.113690 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.113690 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.114745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:39.115225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:43.532269 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:43.534201 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:43.536086 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:46:43.572478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:43.573117 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:43.574153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:43.574153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:43.574153 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:43.574153 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:43.574153 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:43.574153 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:43.574153 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:43.574153 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:43.575216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:43.575898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:44.096840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:44.098223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:44.098544 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:44.098727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.099976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:44.099976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.099976 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:44.099976 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.099976 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.099976 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:44.099976 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.099976 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:44.101967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.102450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:44.102969 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:44.102969 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:44.103571 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:44.103907 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.104802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:44.104802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.104802 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:44.104802 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.104802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.104802 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:44.104802 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.104802 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:44.106087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:44.106626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:44.106626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.106626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:44.106626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.106626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.106626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:44.106626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.106626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:44.107759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.108251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.108723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:44.108723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.108723 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:44.108723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:44.108723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:44.108723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:44.108986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.109483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:44.109483 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.109483 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:44.109483 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.109483 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.109483 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:44.109483 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.109483 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:44.110335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:44.110814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:44.110814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.110814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:44.110814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.110814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.110814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:44.110814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.110814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:44.111341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.111983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:44.112654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.112654 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:44.112654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:44.112978 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:44.113547 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:44.113986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:44.114249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.115245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:44.115245 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.115245 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:44.115245 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.115245 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.115245 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:44.115245 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.115245 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.116517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:44.117057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:48.533181 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:48.535162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:48.568691 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:48.569207 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:48.570216 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:48.570216 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:48.570216 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:48.570216 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:48.570216 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:48.570216 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:48.570216 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:48.570216 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:48.571341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:48.572268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:49.097611 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:49.098902 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:49.099118 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:49.099268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.100056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:49.100056 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.100056 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:49.100056 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.100056 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.100056 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:49.100056 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.100056 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:49.101909 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.102636 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:49.103418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:49.103418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:49.103649 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:49.104026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.105031 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:49.105031 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.105031 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:49.105031 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.105031 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.105031 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:49.105031 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.105031 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:49.106551 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:49.107392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:49.107392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.107392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:49.107392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.107392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.107392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:49.107392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.107392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:49.108086 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.108955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.109815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:49.109815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.109815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:49.109815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:49.109815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:49.109815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:49.109815 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.110454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:49.110454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.110454 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:49.110454 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.110454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.110454 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:49.110454 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.110454 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:49.111245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:49.111764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:49.111764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.111764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:49.111764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.111764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.111764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:49.111764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.111764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:49.112398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.112904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:49.113391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.113391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:49.113391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:49.113391 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:49.113640 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:49.114029 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:49.114270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.115060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:49.115060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.115060 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:49.115060 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.115060 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.115060 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:49.115060 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.115060 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.116044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:49.116527 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:53.536199 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:53.538411 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:53.583909 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:53.584509 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:53.585473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:53.585473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:53.585473 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:53.585473 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:53.585473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:53.585473 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:53.585473 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:53.585473 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:53.586825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:53.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:54.098336 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:54.100278 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:54.100717 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:54.101114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.102354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:54.102354 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.102354 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:54.102354 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.102354 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.102354 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:54.102354 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.102354 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:54.104694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.105609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:54.106621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:54.106621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:54.106621 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:54.106621 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.107522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:54.107522 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.107522 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:54.107522 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.107522 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.107522 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:54.107522 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.107522 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:54.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:54.109721 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:54.110492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.110972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.111465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:54.111465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.111465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:54.111465 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:54.111465 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:54.111465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.112427 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:54.112427 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.112427 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:54.112427 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.112427 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.112427 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:54.112427 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.112427 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:54.113346 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:54.113860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:54.115809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.116411 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:54.117290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.117290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:54.117290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:54.117290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:54.117290 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:54.117290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.117542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:54.117542 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.117542 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:54.117542 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.117542 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.117542 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:54.117542 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.117542 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.118453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:54.118955 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:58.537411 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:58.539085 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:58.579829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:58.580349 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:58.581463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:46:58.581463 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:58.581463 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:58.581463 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:58.581463 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:58.581463 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:58.581463 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:58.581463 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:58.582623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:58.583496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:59.102123 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:59.103841 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:59.104270 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:59.104582 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.105580 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:59.106033 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:46:59.106033 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.106033 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:59.106033 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.106033 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.106033 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:59.106033 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.106033 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:59.108633 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:59.110254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.110817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:59.111603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:59.111603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:59.111603 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:59.111738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.112672 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:59.112943 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.113414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:59.113414 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.113414 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:59.113414 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.113414 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.113414 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:59.113414 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.113414 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:59.114961 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:59.115521 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:46:59.119172 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.119748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:59.120397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:46:59.120811 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:46:59.122455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.123022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.123519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:59.123519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.123519 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:46:59.123519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:59.123519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:46:59.123837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.124702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:46:59.124702 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.124702 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:46:59.124702 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.124702 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.124702 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:46:59.124702 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.124702 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.125852 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:46:59.126352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:03.538172 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:03.539623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:03.576158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:03.576596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:03.577603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:03.577603 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:03.577603 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:03.577603 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:03.577603 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:03.577603 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:03.577603 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:03.577603 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:03.578851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:03.579450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:04.102922 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:04.104793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:04.105260 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:04.105525 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.106727 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:04.106727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.106727 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:04.106727 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.106727 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.106727 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:04.106727 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.106727 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:04.109078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.109531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:04.110061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:04.110061 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:04.110328 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:04.110569 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.111288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:04.111288 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.111288 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:04.111288 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.111288 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.111288 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:04.111288 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.111288 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:04.112982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:04.113840 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:04.115442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.116324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.117253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:04.117253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.117253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:04.117253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:04.117253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:04.117253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:04.117253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:04.117648 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.118543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:04.118543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.118543 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:04.118543 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.118543 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.118543 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:04.118543 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.118543 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:04.120365 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:04.120992 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:04.122900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.123439 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:04.123985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.123985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:04.123985 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:04.123985 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.124453 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:04.124453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.124453 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:04.124453 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.124453 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.124453 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:04.124453 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.124453 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.126108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:04.126600 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:08.539005 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:08.540900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:08.579340 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:08.579696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:08.580614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:08.580614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:08.580614 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:08.580614 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:08.580614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:08.580614 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:08.580614 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:08.580614 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:08.582060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:08.582855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:09.103593 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:09.105166 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:09.105592 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:09.105917 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.106986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:09.106986 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.106986 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:09.106986 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.106986 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.106986 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:09.106986 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.106986 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:09.108344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.108902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:09.109779 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:09.110497 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:09.110812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:09.111078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.111982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:09.111982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.111982 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:09.111982 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.111982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.111982 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:09.111982 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.111982 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:09.112511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:09.113416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:09.113416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.113416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:09.113416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.113416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.113416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:09.113416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.113416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:09.113856 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.114691 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.115936 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:09.116637 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.117678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:09.118201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.118812 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:09.119376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.119376 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:09.119376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:09.119376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:09.119376 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:09.119863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:09.119863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.120373 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:09.120373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.120373 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:09.120373 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.120373 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.120373 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:09.120373 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.120373 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.121796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:09.122403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:13.539734 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:13.541565 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:13.586039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:13.586395 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:13.587398 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:13.587398 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:13.587398 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:13.587398 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:13.587398 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:13.587398 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:13.587398 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:13.587398 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:13.589106 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:13.589984 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:14.104387 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:14.106530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:14.106951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:14.107228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.108478 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:14.108478 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.108478 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:14.108478 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.108478 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.108478 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:14.108478 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.108478 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:14.110548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.111185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:14.111781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:14.111781 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:14.112011 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:14.112335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.113122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:14.113122 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.113122 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:14.113122 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.113122 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.113122 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:14.113122 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.113122 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:14.114403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:14.114924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:14.114924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.114924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:14.114924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.114924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.114924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:14.114924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.114924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:14.116297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.116749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.117310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:14.117310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.117310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:14.117310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:14.117310 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:14.117845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:14.118103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.118595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:14.118595 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.118595 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:14.118595 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.118595 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.118595 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:14.118595 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.118595 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:14.119667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:14.120204 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:14.121594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.122113 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:14.122658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.122658 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:14.122658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:14.122658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:14.122798 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:14.123018 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.123802 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:14.123802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.123802 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:14.123802 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.123802 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.123802 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:14.123802 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.123802 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.125682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:14.126240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:18.540616 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:18.542422 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:18.584031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:18.584436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:18.585506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:18.585506 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:18.585506 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:18.585506 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:18.585506 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:18.585506 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:18.585506 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:18.585506 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:18.586944 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:18.587995 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:19.105386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:19.106803 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:19.107417 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:19.107417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.108359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:19.108359 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.108359 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:19.108359 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.108359 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.108359 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:19.108359 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.108359 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:19.110423 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.110928 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:19.111415 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:19.112024 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:19.112494 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:19.112708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.113405 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:19.113405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.113405 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:19.113405 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.113405 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.113405 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:19.113405 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.113405 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:19.115750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:19.116249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:19.116249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.116249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:19.116249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.116249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.116249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:19.116249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.116249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:19.117677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.118139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.118674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:19.118674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.118674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:19.118674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:19.118959 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:19.119576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:19.120206 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.120905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:19.120905 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.120905 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:19.120905 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.120905 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.120905 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:19.120905 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.120905 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:19.122608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:19.123706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:19.123706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.123706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:19.123706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.123706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.123706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:19.123706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.123706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:19.125228 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.125690 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:19.126292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.126292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:19.126292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:19.126292 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:19.127088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:19.127436 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:19.127670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.128455 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:19.128455 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.128455 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:19.128455 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.128455 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.128455 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:19.128455 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.128455 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.130112 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:19.130616 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:23.541456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:23.543537 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:23.584222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:23.584743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:23.585904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:23.585904 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:23.585904 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:23.585904 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:23.585904 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:23.585904 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:23.585904 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:23.585904 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:23.587443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:23.588969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:24.106082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:24.107435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:24.107801 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:24.107982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.109156 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:24.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:24.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.109156 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:24.109156 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.109156 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:24.112151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.112666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:24.113285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:24.113285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:24.113285 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:24.113522 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.114240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:24.114240 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.114240 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:24.114240 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.114240 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.114240 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:24.114240 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.114240 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:24.115108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:24.115969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:24.115969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.115969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:24.115969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.115969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.115969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:24.115969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.115969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:24.116303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.116792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.117465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:24.117465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.117465 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:24.118725 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:24.119072 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:24.119449 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:24.119678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.120265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:24.120265 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.120265 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:24.120265 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.120265 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.120265 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:24.120265 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.120265 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:24.121053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:24.121850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:24.121850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.121850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:24.121850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.121850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.121850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:24.121850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.121850 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:24.122227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.122976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:24.123797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.123797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:24.126101 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:24.126454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:24.126739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:24.126984 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:24.127323 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.127925 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:24.127925 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.127925 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:24.127925 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.127925 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.127925 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:24.127925 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.127925 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.128891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:24.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:28.542758 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:28.544814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:28.585744 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:28.586386 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:28.587617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:28.587617 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:28.587617 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:28.587617 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:28.587617 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:28.587617 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:28.587617 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:28.587617 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:28.589174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:28.590121 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:29.106714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:29.108266 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:29.108619 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:29.108837 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.109806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:29.109806 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.109806 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:29.109806 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.109806 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.109806 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:29.109806 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.109806 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:29.111594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.112456 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:29.113435 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:29.114110 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:29.114392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:29.114498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.115466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:29.115466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.115466 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:29.115466 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.115466 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.115466 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:29.115466 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.115466 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:29.116594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:29.117758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:29.117758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.117758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:29.117758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.117758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.117758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:29.117758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.117758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:29.118328 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.119472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.120517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:29.120517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.120517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:29.120517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:29.120517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:29.120517 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:29.120517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.120997 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:29.120997 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.120997 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:29.120997 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.120997 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.120997 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:29.120997 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.120997 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:29.122097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:29.122755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:29.122755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.122755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:29.122755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.122755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.122755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:29.122755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.122755 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:29.123628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.124270 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:29.124854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.124854 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:29.126549 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:29.127037 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:29.127480 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:29.127835 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:29.128083 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.128737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:29.128737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.128737 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:29.128737 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.128737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.128737 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:29.128737 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.128737 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.130217 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:29.130715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:33.543515 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:33.545396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:33.581342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:33.582024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:33.585548 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:33.585548 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:33.585548 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:33.585548 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:33.585548 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:33.585548 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:33.585548 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:33.585548 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:33.587058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:33.587981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:34.107515 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:34.113489 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:34.116082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:34.116701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:34.117299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:34.117500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.118560 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:34.118921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.120536 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:47:34.120536 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.120536 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:34.120536 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.120536 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.120536 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:34.120536 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.120536 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:34.121169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:34.123759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.124311 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:34.124838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:34.124838 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.124838 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:34.124838 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.124838 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.124838 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:34.124838 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.124838 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:34.125098 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:34.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:34.127967 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:34.128281 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:34.130103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.130809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.131757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:34.131757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.131757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:34.131757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.131757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:34.132055 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:34.132623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:34.132623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.132623 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:34.132623 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.132623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.132623 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:34.132623 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.132623 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:34.133360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:34.134303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:34.135081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:34.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.137184 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:34.138020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:34.139103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:34.140675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:34.140675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:34.140675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:34.140675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:34.140675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:34.140675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:34.140675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:38.544429 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:38.546210 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:38.587018 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:38.587254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:38.587934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:38.587934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:38.587934 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:38.587934 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:38.587934 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:38.587934 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:38.587934 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:38.587934 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:38.588718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:38.589834 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:39.115164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:39.116412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:39.117232 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:39.118409 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:39.118868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:39.119168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.120329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:39.120329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.120329 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:39.120329 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.120329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.120329 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:39.120329 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.120329 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.122609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.123434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:39.124175 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:39.124175 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:39.124175 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.124947 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:39.125975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:47:39.125975 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.125975 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:39.125975 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.125975 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.125975 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:39.125975 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.125975 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:39.127516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:39.128469 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:39.129155 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.129945 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.130559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:39.130559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.130559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:39.130559 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.130559 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:39.131095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:39.131095 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.131095 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:39.131095 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.131095 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.131095 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:39.131095 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.131095 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:39.131831 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:39.133993 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:39.134845 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:39.136583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.137418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:39.138446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.138446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:39.138446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:39.138446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.138714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:47:39.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:39.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:39.138714 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.138714 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.140341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:39.141276 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:43.545106 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:43.546510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:43.548927 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:47:43.583613 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:43.584125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:43.585254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:43.585254 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:43.585254 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:43.585254 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:43.585254 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:43.585254 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:43.585254 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:43.585254 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:43.586186 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:43.586675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:44.115951 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:44.117244 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:44.117735 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:44.118826 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:44.119439 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:44.119712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.120813 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:44.120813 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.120813 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:44.120813 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.120813 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.120813 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:44.120813 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.120813 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:44.121557 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.123732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.124299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:44.124784 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.124784 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:44.125111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:44.126151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:44.126769 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.127497 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:44.127497 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.127497 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:44.127497 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.127497 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.127497 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:44.127497 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.127497 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:44.128399 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.129296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:44.129790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:44.129790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.129790 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:44.129790 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.129790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.129790 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:44.129790 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.129790 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:44.131098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.132043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.132828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:44.132828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.132828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:44.133049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:44.134109 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:44.135362 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.135989 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:44.136482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.136482 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:44.136482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:44.136482 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:44.136643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:44.136887 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.137708 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:44.137708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.137708 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:44.137708 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.137708 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.137708 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:44.137708 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.137708 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.138998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:44.139554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:48.546073 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:48.547548 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:48.584666 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:48.585124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:48.586234 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:48.586234 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:48.586234 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:48.586234 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:48.586234 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:48.586234 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:48.586234 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:48.586234 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:48.587624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:48.588951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:49.116828 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:49.117958 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:49.118860 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:49.119533 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:49.119863 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:49.120054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.121119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:49.121119 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.121119 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:49.121119 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.121119 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.121119 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:49.121119 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.121119 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:49.121512 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.123508 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.124119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:49.124661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.124901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:49.124901 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.124901 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:49.124901 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.124901 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.124901 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:49.124901 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.124901 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:49.126640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:49.127381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:49.129114 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.129688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.130392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:49.130392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.130392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:49.130392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:49.130392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:49.130392 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.131237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:49.131237 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.131237 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:49.131237 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.131237 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.131237 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:49.131237 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.131237 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:49.132190 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:49.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:49.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:49.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:49.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:49.133829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.134356 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:49.134983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.134983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:49.134983 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:49.135390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:49.136050 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:49.136278 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:49.136431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.137138 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:49.137138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.137138 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:49.137138 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.137138 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.137138 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:49.137138 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.137138 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.139231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:49.139739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:53.546694 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:53.548661 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:53.595769 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:53.596058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:53.596920 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:53.596920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:53.596920 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:53.596920 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:53.596920 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:53.596920 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:53.596920 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:53.596920 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:53.598324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:53.598946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:54.117829 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:54.119120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:54.119815 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:54.120408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:54.120646 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:54.120810 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.121896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:54.121896 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.121896 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:54.121896 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.121896 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.121896 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:54.121896 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.121896 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:54.122392 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.124417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.125105 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.126333 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:54.126614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.127157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:54.128689 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.129272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.129776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:54.129776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.129776 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:54.129776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:54.129776 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:54.130377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:54.130716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.131301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:54.131301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.131301 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:54.131301 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.131301 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.131301 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:54.131301 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.131301 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:54.132335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:54.132922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:54.132922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.132922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:54.132922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.132922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.132922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:54.132922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.132922 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:54.133489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.134098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:54.134757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.134757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:54.135394 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:54.136251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:54.136656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:54.137082 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:54.137247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.138982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:54.138982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.138982 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:54.138982 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.138982 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.138982 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:54.138982 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.138982 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.139526 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:54.140472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:58.547543 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:58.549209 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:58.589367 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:58.589814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:58.590979 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:47:58.590979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:58.590979 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:58.590979 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:58.590979 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:58.590979 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:58.590979 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:58.590979 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:58.591966 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:58.593040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:59.118656 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:59.120328 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:59.120530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:59.123453 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:59.123661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.124401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:47:59.125677 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:59.125677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.125677 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:59.125677 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.125677 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.125677 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:59.125677 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.125677 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:59.126331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.127618 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:59.130071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.131249 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:59.131510 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:59.131510 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.131510 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:59.131510 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.131510 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.131510 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:59.131510 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.131510 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:59.132715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.133523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:47:59.133976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.134661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.135567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:59.135567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.135567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:59.135793 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:59.136355 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:47:59.136783 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:59.137383 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.138377 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:47:59.138714 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:47:59.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:59.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.138714 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:59.138714 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.138714 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:47:59.139446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:47:59.140581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.141199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:59.141695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.141695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:47:59.141695 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:59.141695 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:47:59.141695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.142126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:47:59.142126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.142126 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:47:59.142126 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.142126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.142126 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:47:59.142126 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.142126 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.143150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:47:59.143642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:03.548251 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:03.549450 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:03.591729 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:03.592072 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:03.593080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:48:03.593080 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:03.593080 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:03.593080 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:03.593080 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:03.593080 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:03.593080 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:03.593080 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:03.594010 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:03.594594 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:04.119393 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:04.121071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:04.121464 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:04.122103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.122836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:04.122836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.122836 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:04.122836 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.122836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.122836 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:04.122836 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.122836 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.124912 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.125675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:04.126514 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:04.126514 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:04.126857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:04.127199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.127968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:04.127968 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.127968 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:04.127968 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.127968 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.127968 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:04.127968 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.127968 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:04.128900 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:04.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:04.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:04.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:04.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.129403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:04.130063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.131014 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.131667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:04.131667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.131667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:04.134023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:04.134775 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:04.135412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:04.135792 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.136696 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:04.136696 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.136696 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:04.136696 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.136696 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.136696 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:04.136696 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.136696 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:04.138297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.138829 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:04.140223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.140801 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:04.141414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.141414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:04.141414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:04.141414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:04.141414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:04.141772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:04.142043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.142901 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:04.142901 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.142901 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:04.142901 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.142901 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.142901 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:04.142901 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.142901 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.144205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:04.144809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:08.549189 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:08.550675 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:08.599446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:08.599891 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:08.600752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:48:08.600752 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:08.600752 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:08.600752 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:08.600752 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:08.600752 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:08.600752 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:08.600752 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:08.601804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:08.602348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:09.120229 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:09.121890 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:09.122478 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:09.122715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.123853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:09.123853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.123853 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:09.123853 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.123853 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.123853 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:09.123853 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.123853 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.125724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.126310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:09.126861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:09.126861 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:09.127234 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:09.127592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.128335 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:09.128335 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.128335 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:09.128335 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.128335 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.128335 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:09.128335 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.128335 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:09.129682 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:09.130338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:09.130338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.130338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:09.130338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.130338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.130338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:09.130338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.130338 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:09.131269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.131904 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.132470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:09.132470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.132470 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:09.134552 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:09.135058 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:09.135469 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:09.135773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.136687 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:09.136687 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.136687 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:09.136687 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.136687 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.136687 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:09.136687 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.136687 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:09.137736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.138650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:09.139640 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.140227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:09.140827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.140827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:09.140963 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:09.142114 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:09.142469 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:09.142632 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:09.142750 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.143242 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:09.143242 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.143242 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:09.143242 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.143242 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.143242 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:09.143242 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.143242 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.145124 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:09.145725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:13.550048 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:13.551749 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:13.586709 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:13.587153 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:13.588224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:48:13.588224 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:13.588224 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:13.588224 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:13.588224 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:13.588224 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:13.588224 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:13.588224 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:13.589231 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:13.590094 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:14.121169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:14.123160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:14.123160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:14.123598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.124384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:14.124384 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.124384 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:14.124384 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.124384 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.124384 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:14.124384 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.124384 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.126029 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.126647 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:14.127456 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:14.127911 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:14.128671 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:14.128921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.129523 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:14.129523 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.129523 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:14.129523 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.129523 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.129523 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:14.129523 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.129523 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:14.130905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:14.131488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:14.131488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.131488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:14.131488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.131488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.131488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:14.131488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.131488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:14.132475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.133075 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.133601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:14.133601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.133601 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:14.135200 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:14.136034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:14.136414 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:14.136683 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.137459 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:14.137459 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.137459 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:14.137459 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.137459 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.137459 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:14.137459 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.137459 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:14.138605 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.139157 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:14.139797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.140334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:14.141022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.141022 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:14.141650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:14.142246 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:14.142892 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:14.143348 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:14.143587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.144672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:14.144672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.144672 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:14.144672 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.144672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.144672 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:14.144672 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.144672 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:14.147402 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:18.550953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:18.553007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:18.592463 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:18.593002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:18.594122 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:48:18.594122 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:18.594122 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:18.594122 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:18.594122 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:18.594122 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:18.594122 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:18.594122 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:18.595226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:18.596331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:19.121995 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:19.123309 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:19.123589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:19.123822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.124631 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:19.124631 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.124631 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:19.124631 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.124631 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.124631 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:19.124631 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.124631 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.126238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.127462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:19.128627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:19.128627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:19.128792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:19.129009 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.129516 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:19.129516 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.129516 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:19.129516 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.129516 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.129516 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:19.129516 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.129516 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:19.130785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:19.131450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:19.131450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.131450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:19.131450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.131450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.131450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:19.131450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.131450 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:19.132098 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.132702 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.133267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:19.133267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.133267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:19.135667 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:19.136486 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:19.137089 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:19.137429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.138298 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:19.138298 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.138298 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:19.138298 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.138298 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.138298 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:19.138298 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.138298 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:19.139775 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.140293 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:19.141546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.142078 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:19.142633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.142633 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:19.142633 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:19.142742 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:19.143129 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:19.143454 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:19.143674 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.144397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:19.144397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.144397 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:19.144397 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.144397 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.144397 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:19.144397 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.144397 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.146038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:19.146704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:23.551790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:23.553657 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:23.588592 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:23.589043 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:23.590390 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:48:23.590390 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:23.590390 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:23.590390 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:23.590390 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:23.590390 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:23.590390 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:23.590390 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:23.592552 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:23.593310 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:24.122844 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:24.124442 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:24.124899 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:24.125261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.126661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:24.126661 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.126661 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:24.126661 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.126661 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.126661 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:24.126661 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.126661 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.128706 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.129685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:24.130434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:24.130434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:24.130434 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:24.130694 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.131475 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:24.131475 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.131475 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:24.131475 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.131475 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.131475 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:24.131475 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.131475 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:24.132902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:24.133743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:24.133743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.133743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:24.133743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.133743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.133743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:24.133743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.133743 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:24.134575 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.135424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.136400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:24.136400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.136400 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:24.136400 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:24.136895 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:24.137381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:24.137606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.138317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:24.138317 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.138317 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:24.138317 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.138317 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.138317 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:24.138317 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.138317 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:24.140220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.140785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:24.142303 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.142739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:24.143267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.143267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:24.143267 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:24.143360 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:24.144095 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:24.144511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:24.144765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.145588 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:24.145588 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.145588 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:24.145588 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.145588 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.145588 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:24.145588 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.145588 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.146645 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:24.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:28.552814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:28.555131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:28.590814 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:28.591253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:28.592111 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:48:28.592111 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:28.592111 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:28.592111 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:28.592111 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:28.592111 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:28.592111 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:28.592111 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:28.593316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:28.594759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:29.123589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:29.125040 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:29.125523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:29.125800 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.126906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:29.126906 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.126906 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:29.126906 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.126906 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.126906 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:29.126906 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.126906 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.128906 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.130021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:29.131212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:29.131212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:29.131212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:29.131434 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.132283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:29.132283 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.132283 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:29.132283 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.132283 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.132283 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:29.132283 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.132283 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:29.133814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:29.134384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:29.134384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.134384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:29.134384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.134384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.134384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:29.134384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.134384 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:29.134949 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.135433 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.135978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:29.135978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.135978 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:29.136512 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:29.136857 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:29.137203 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:29.137472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.138017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:29.138017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.138017 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:29.138017 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.138017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.138017 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:29.138017 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.138017 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:29.138808 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.139308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:29.140245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.140767 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:29.141350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.141350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:29.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:29.143768 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:29.144288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:29.144713 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:29.145006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.145843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:29.145843 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.145843 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:29.145843 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.145843 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.145843 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:29.145843 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.145843 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.147108 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:29.147592 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:33.553590 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:33.556036 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:33.589375 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:33.589851 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:33.590861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:48:33.590861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:33.590861 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:33.590861 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:33.590861 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:33.590861 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:33.590861 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:33.590861 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:33.591976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:33.592822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:34.124427 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:34.125972 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:34.126313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:34.126494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.127321 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:34.127321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.127321 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:34.127321 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.127321 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.127321 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:34.127321 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.127321 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.128583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.129479 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:34.130381 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:34.130716 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:34.131218 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:34.131422 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.131969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:34.131969 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.131969 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:34.131969 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.131969 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.131969 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:34.131969 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.131969 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:34.132919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.133847 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:34.134679 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.135664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:34.136873 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:34.137485 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:34.137931 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:34.138168 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.138737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:34.138737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.138737 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:34.138737 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.138737 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.138737 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:34.138737 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.138737 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:34.139747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.140180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:34.141215 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.141766 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:34.142382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.142382 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:34.143598 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:34.144080 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:34.144384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:34.144610 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:34.144785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.145331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:34.145331 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.145331 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:34.145331 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.145331 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.145331 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:34.145331 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.145331 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.147324 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:34.148229 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:38.554715 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:38.555973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:38.595020 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:38.595291 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:38.595919 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:48:38.595919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:38.595919 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:38.595919 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:38.595919 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:38.595919 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:38.595919 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:38.595919 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:38.597081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:38.598069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:39.125311 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:39.127075 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:39.127436 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:39.127716 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.129049 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:39.129049 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.129049 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:39.129049 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.129049 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.129049 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:39.129049 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.129049 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.131081 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.132266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:39.133288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:39.133288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:39.133288 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:39.133288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.133614 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:39.133614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.133614 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:39.133614 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.133614 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.133614 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:39.133614 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.133614 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:39.134950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:39.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:39.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:39.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:39.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.135747 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:39.136788 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.137753 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.138595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:39.138595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.138595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:39.138595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:39.138595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:39.138595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:39.138595 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.139076 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:39.139076 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.139076 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:39.139076 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.139076 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.139076 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:39.139076 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.139076 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:39.140715 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.141403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:39.141981 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.142698 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:39.143567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.143567 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:39.144014 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:39.144630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:39.145083 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:39.145379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:39.145580 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.146143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:39.146143 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.146143 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:39.146143 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.146143 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.146143 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:39.146143 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.146143 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.147417 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:39.147982 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:43.556007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:43.557993 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:43.560169 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=240 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:48:43.600538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:43.600835 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:43.601946 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Traceback (most recent call last):
Mar 19 18:48:43.601946 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:43.601946 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:43.601946 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:43.601946 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:43.601946 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:43.601946 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:43.601946 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-fa4e27c7-ae15-4d15-b46b-57cc3770665f None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:43.603316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:43.604026 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:44.126540 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:44.127837 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:44.128401 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:44.128675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.129915 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:44.129915 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.129915 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:44.129915 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.129915 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.129915 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:44.129915 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.129915 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.131261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.132252 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:44.133212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:44.133212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:44.133212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:44.133446 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.134271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:44.134271 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.134271 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:44.134271 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.134271 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.134271 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:44.134271 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.134271 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:44.135718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:44.136269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:44.136269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.136269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:44.136269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.136269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.136269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:44.136269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.136269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:44.138238 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.138738 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.139265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:44.139265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.139265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:44.139265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:44.139265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:44.139265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:44.139498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.140037 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:44.140037 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.140037 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:44.140037 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.140037 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.140037 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:44.140037 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.140037 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:44.141005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.141701 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:44.142213 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.142972 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:44.143795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.143795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:44.144665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:44.145745 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:44.145963 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:44.146120 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:44.146361 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.147071 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:44.147071 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.147071 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:44.147071 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.147071 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.147071 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:44.147071 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.147071 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.148337 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:44.149363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:48.556747 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:48.558384 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:48.596325 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:48.596603 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:48.597226 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:48:48.597226 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:48.597226 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:48.597226 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:48.597226 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:48.597226 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:48.597226 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:48.597226 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:48.598532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:48.599136 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:49.127446 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:49.128726 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:49.129071 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:49.129265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.130167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:49.130167 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.130167 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:49.130167 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.130167 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.130167 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:49.130167 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.130167 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.132000 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.133289 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.134538 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:49.135754 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:49.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:49.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:49.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:49.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:49.137528 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.138240 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.138975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:49.138975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.138975 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:49.138975 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:49.139743 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:49.140356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:49.140794 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.141672 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:49.141672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.141672 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:49.141672 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.141672 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.141672 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:49.141672 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.141672 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:49.143139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.143745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:49.144921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.145541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:49.146245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.146245 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:49.146245 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:49.146245 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:49.146589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:49.146763 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:49.146934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.147699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:49.147699 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.147699 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:49.147699 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.147699 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.147699 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:49.147699 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.147699 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.148990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:49.149819 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:53.557741 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:53.559641 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:53.600366 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:53.600749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:53.601765 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:48:53.601765 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:53.601765 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:53.601765 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:53.601765 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:53.601765 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:53.601765 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:53.601765 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:53.602825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:53.603678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:54.128432 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:54.130223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:54.130739 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:54.131178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.132419 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:54.132419 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.132419 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:54.132419 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.132419 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.132419 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:54.132419 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.132419 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.135740 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.136737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:54.138202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:54.138202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:54.138202 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:54.138202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.138980 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:54.138980 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.138980 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:54.138980 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.138980 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.138980 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:54.138980 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.138980 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:54.140080 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:54.140736 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:54.141969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.142489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.143063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:54.143063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.143063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:54.143063 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:54.143063 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:54.143442 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.144499 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:54.144499 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.144499 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:54.144499 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.144499 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.144499 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:54.144499 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.144499 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:54.146269 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.146845 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:54.147681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.148205 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:54.148675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.148675 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:54.148675 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:54.148928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:54.150160 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:54.151000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:54.151385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.152608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:54.152608 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.152608 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:54.152608 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.152608 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.152608 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:54.152608 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.152608 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.153970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:54.154492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:58.579027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:58.579027 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:58.597933 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:58.598500 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:58.599599 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:48:58.599599 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:58.599599 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:58.599599 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:58.599599 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:58.599599 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:58.599599 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:58.599599 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:58.600560 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:58.601506 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:59.129206 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:59.130737 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:59.131105 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:59.131554 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.132241 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:59.132241 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.132241 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:59.132241 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.132241 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.132241 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:59.132241 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.132241 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.134237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.135466 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:59.137257 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:59.138351 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:48:59.138952 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:59.139174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.139863 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:59.139863 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.139863 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:59.139863 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.139863 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.139863 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:59.139863 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.139863 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:59.141656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:59.142413 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:48:59.143271 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.143932 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.144628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:59.144628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.144628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:59.144628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:59.144628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:59.144628 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.145403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:48:59.145403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.145403 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:59.145403 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.145403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.145403 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:59.145403 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.145403 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:48:59.146251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.147019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:48:59.147424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.148294 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:59.149606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.149606 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:48:59.149606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:48:59.149606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:48:59.149606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:59.150048 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:48:59.150297 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.151501 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:48:59.151501 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.151501 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:48:59.151501 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.151501 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.151501 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:48:59.151501 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.151501 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.152761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:48:59.153437 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:03.559262 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:03.560740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:03.595356 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:03.595643 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:03.596498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:49:03.596498 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:03.596498 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:03.596498 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:03.596498 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:03.596498 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:03.596498 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:03.596498 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:03.597577 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:03.598147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:04.130107 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:04.131921 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:04.132379 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:04.132661 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.133841 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:04.133841 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.133841 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:04.133841 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.133841 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.133841 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:04.133841 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.133841 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.135719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.136650 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:04.138289 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:04.138674 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:04.139222 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:04.139444 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.140079 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:04.140079 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.140079 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:04.140079 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.140079 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.140079 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:04.140079 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.140079 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:04.141462 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:04.142089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:04.142089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.142089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:04.142089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.142089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.142089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:04.142089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.142089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:04.143119 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.143609 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.144133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:04.144133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.144133 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:04.144133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:04.144133 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:04.144515 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:04.144887 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.145757 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:49:04.145757 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.145757 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:04.145757 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.145757 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.145757 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:04.145757 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.145757 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:04.147053 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.147494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:04.148976 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.149431 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:04.149958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.149958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:04.149958 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:04.149958 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:04.150354 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:04.150754 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:04.150959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.151697 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:04.151697 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.151697 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:04.151697 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.151697 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.151697 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:04.151697 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.151697 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.152814 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:04.153317 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:08.560212 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:08.561818 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:08.599431 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:08.599977 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:08.601056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:49:08.601056 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:08.601056 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:08.601056 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:08.601056 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:08.601056 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:08.601056 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:08.601056 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:08.602325 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:08.603224 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:09.131131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:09.133039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:09.133412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:09.133745 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.134761 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:09.134761 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.134761 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:09.134761 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.134761 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.134761 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:09.134761 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.134761 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.136786 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.137660 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:09.138779 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:09.139054 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:09.139595 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:09.139948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.140686 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:09.140686 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.140686 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:09.140686 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.140686 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.140686 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:09.140686 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.140686 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:09.141670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:09.142452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:09.142452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.142452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:09.142452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.142452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.142452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:09.142452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.142452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:09.142858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.143626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.144665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:09.144665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.144665 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:09.144665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:09.144665 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:09.144987 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:09.145220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.145903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:49:09.145903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.145903 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:09.145903 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.145903 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.145903 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:09.145903 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.145903 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:09.147013 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.147438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:09.148285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.148734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:09.149351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.149351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:09.149759 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:09.150436 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:09.151650 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:09.152003 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:09.152180 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.152968 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:09.152968 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.152968 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:09.152968 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.152968 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.152968 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:09.152968 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.152968 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.154796 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:09.155290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:13.560683 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:13.562078 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:13.599785 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:13.600141 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:13.601251 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:49:13.601251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:13.601251 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:13.601251 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:13.601251 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:13.601251 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:13.601251 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:13.601251 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:13.602608 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:13.603563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:14.132162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:14.133807 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:14.134141 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:14.134318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.135273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:14.135273 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.135273 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:14.135273 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.135273 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.135273 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:14.135273 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.135273 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.136710 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.137278 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:14.139148 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:14.139437 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:14.139937 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:14.140167 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:14.140797 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.140797 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:14.140797 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.140797 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.140797 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:14.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.140797 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:14.141962 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:14.142758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:14.142758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.142758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:14.142758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.142758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.142758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:14.142758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.142758 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:14.143351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.143934 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.144598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:14.144598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.144598 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:14.144598 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:14.144994 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:14.145640 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:14.146039 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.147038 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:49:14.147038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.147038 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:14.147038 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.147038 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.147038 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:14.147038 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.147038 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:14.149420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:14.150555 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:14.151125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:14.151855 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:14.152511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:14.152511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:14.152511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.153230 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:14.153230 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.153230 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:14.153230 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.153230 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.153230 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:14.153230 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.153230 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.154604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:14.155474 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:18.561490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:18.563231 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:18.604772 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:18.605268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:18.606227 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:49:18.606227 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:18.606227 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:18.606227 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:18.606227 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:18.606227 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:18.606227 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:18.606227 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:18.607285 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:18.608185 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:19.133094 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:19.134719 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:19.134979 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:19.135151 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.135965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:19.135965 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.135965 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:19.135965 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.135965 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.135965 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:19.135965 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.135965 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.137899 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.138756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:19.139659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:19.140102 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:19.140727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:19.141235 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.142314 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:19.142314 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.142314 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:19.142314 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.142314 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.142314 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:19.142314 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.142314 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:19.143685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:19.144247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:19.144247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.144247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:19.144247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.144247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.144247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:19.144247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.144247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:19.145440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.145921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.146416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:19.146416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.146416 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:19.146416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:19.146416 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:19.146689 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:19.147253 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.148110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:19.148110 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.148110 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:19.148110 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.148110 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.148110 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:19.148110 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.148110 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:19.148942 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:19.149354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:19.149354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.149354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:19.149354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.149354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.149354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:19.149354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.149354 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:19.150058 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.150494 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:19.151077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.151077 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:19.151077 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:19.151636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:19.152224 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:19.152424 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:19.152576 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.153204 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:19.153204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.153204 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:19.153204 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.153204 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.153204 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:19.153204 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.153204 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.155020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:19.155545 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:23.562158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:23.564128 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:23.600960 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:23.601313 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:23.602353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:49:23.602353 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:23.602353 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:23.602353 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:23.602353 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:23.602353 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:23.602353 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:23.602353 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:23.603393 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:23.604196 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:24.133917 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:24.135418 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:24.135717 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:24.135905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.136860 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:24.136860 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.136860 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:24.136860 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.136860 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.136860 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:24.136860 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.136860 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.138662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.139771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:24.140765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:24.140765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:24.141116 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:24.141667 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.142353 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:24.142353 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.142353 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:24.142353 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.142353 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.142353 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:24.142353 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.142353 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:24.143799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:24.144644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:24.144644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.144644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:24.144644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.144644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.144644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:24.144644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.144644 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.146139 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.146642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:24.146642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.146642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:24.146642 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:24.146773 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:24.147423 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:24.147656 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.148512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:49:24.148512 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.148512 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:24.148512 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.148512 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.148512 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:24.148512 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.148512 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:24.149719 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.150182 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:24.150816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.151301 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:24.151858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.151858 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:24.151858 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:24.152321 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:24.152973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:24.153607 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:24.153607 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.154202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:24.154202 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.154202 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:24.154202 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.154202 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.154202 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:24.154202 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.154202 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.155067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:24.155695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:28.563137 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:28.564859 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:28.602986 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:28.603759 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:28.604948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:49:28.604948 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:28.604948 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:28.604948 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:28.604948 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:28.604948 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:28.604948 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:28.604948 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:28.606281 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:28.606990 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:29.134663 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:29.136223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:29.136530 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:29.136725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.137668 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:29.137668 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.137668 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:29.137668 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.137668 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.137668 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:29.137668 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.137668 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.139617 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.140540 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:29.141396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:29.141396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:29.141396 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:29.141563 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.142149 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:29.142149 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.142149 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:29.142149 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.142149 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.142149 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:29.142149 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.142149 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:29.143414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:29.144420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:29.144420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.144420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:29.144420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.144420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.144420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:29.144420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.144420 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:29.145246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.145826 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.146360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:29.146360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.146360 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:29.146699 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:29.147723 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:29.148207 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:29.148448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.149435 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:49:29.149435 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.149435 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:29.149435 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.149435 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.149435 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:29.149435 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.149435 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:29.150504 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.150924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:29.151685 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.152143 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:29.152724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.152724 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:29.152724 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:29.153103 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:29.153477 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:29.153804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:29.154069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.155219 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:29.155219 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.155219 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:29.155219 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.155219 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.155219 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:29.155219 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.155219 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.157388 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:29.157903 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:33.563760 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:33.565956 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:33.601923 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:33.602391 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:33.603623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:49:33.603623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:33.603623 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:33.603623 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:33.603623 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:33.603623 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:33.603623 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:33.603623 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:33.604825 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:33.605489 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:34.135417 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:34.137062 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:34.137419 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:34.137684 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.139345 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:34.139345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.139345 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:34.139345 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.139345 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.139345 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:34.139345 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.139345 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.141512 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.142109 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:34.142576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:34.142809 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:34.143436 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:34.143662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.144295 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:34.144295 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.144295 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:34.144295 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.144295 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.144295 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:34.144295 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.144295 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:34.145838 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:34.146308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:34.146308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.146308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:34.146308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.146308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.146308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:34.146308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.146308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:34.147733 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.148249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:34.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:34.148806 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:34.149065 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:34.149741 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:34.150331 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.151473 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:49:34.151473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.151473 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:34.151473 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.151473 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.151473 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:34.151473 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.151473 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:34.152410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.153067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:34.154389 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.155287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:34.156161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.156161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:34.156161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:34.156161 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:34.156553 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:34.156765 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:34.156971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.157916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:49:34.157916 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.157916 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:34.157916 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.157916 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.157916 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:34.157916 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.157916 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.159344 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:34.159861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:37.991353 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:38.000172 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Synchronizing Neutron and OVN databases started {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:389}}
Mar 19 18:49:38.000172 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Number of inconsistencies found at create/update: networks=4, routers=1, router_ports=1 {{(pid=103900) _log /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:370}}
Mar 19 18:49:38.000408 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:49:38.036659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, resource={'id': '3fbbc8ff-d939-4c17-8632-0e651722214d', 'name': 'private', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['9f0bbfcd-2c36-41e2-a0c3-67cc7d91cebb', 'bee598c2-f62b-4321-b08d-23e3a7c6ccb9'], 'standard_attr_id': 12, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:09:27Z', 'updated_at': '2026-03-19T18:09:31Z', 'revision_number': 3, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 29513}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.036659 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-3fbbc8ff-d939-4c17-8632-0e651722214d, col_values=(('external_ids', {'neutron:network_name': 'private', 'neutron:mtu': '1372', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-b55270e8-5359-4f54-8804-fcbd7769eee3, external_ids_update=None, columns={'tag': 29513}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.037150 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource 3fbbc8ff-d939-4c17-8632-0e651722214d (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.038799 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.039662 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.040299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:49:38.040299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.040299 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:49:38.040299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:49:38.067088 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, resource={'id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'name': 'public', 'tenant_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'project_id': 'cb4c4f6900804f8abc0c06ce2041a47a', 'admin_state_up': True, 'mtu': 1430, 'status': 'ACTIVE', 'subnets': ['7888df47-ce34-4091-9e08-c1c5949f53a2', 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'], 'standard_attr_id': 18, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': True, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'is_default': True, 'tags': [], 'created_at': '2026-03-19T18:09:34Z', 'updated_at': '2026-03-19T18:09:44Z', 'revision_number': 3, 'provider:network_type': 'flat', 'provider:physical_network': 'public', 'provider:segmentation_id': None}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.067510 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, col_values=(('external_ids', {'neutron:network_name': 'public', 'neutron:mtu': '1430', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'flat', 'neutron:provnet-physical-network': 'public'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false', 'fdb_age_threshold': '300', 'broadcast-arps-to-all-routers': 'true'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.068074 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-20b6196a-9254-4b37-a645-8253845242a7, external_ids_update=None, columns={'tag': []}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.068377 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.069302 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:49:38.069302 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.069302 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:38.069302 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.069302 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.069302 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:38.069302 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.069302 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource 409b35e2-57e1-45b1-9dfd-29d98c18276b (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.070312 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.071220 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.071804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:49:38.071804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.071804 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:49:38.071804 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:49:38.100681 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-420e2995-aa57-46db-9651-85807f50bcb9, resource={'id': '420e2995-aa57-46db-9651-85807f50bcb9', 'name': 'admin_net', 'tenant_id': '1ed140779dbc462d89fd3e785886b2bb', 'project_id': '1ed140779dbc462d89fd3e785886b2bb', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['388b450f-f17e-4671-94e9-9f169d754be7'], 'standard_attr_id': 42, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:13:33Z', 'updated_at': '2026-03-19T18:13:34Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 28229}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.101039 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-420e2995-aa57-46db-9651-85807f50bcb9, col_values=(('external_ids', {'neutron:network_name': 'admin_net', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.101398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-07b4049d-60f0-4621-a8e7-5dcac93308be, external_ids_update=None, columns={'tag': 28229}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.101541 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.102849 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:49:38.102849 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.102849 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:38.102849 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.102849 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.102849 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:38.102849 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.102849 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource 420e2995-aa57-46db-9651-85807f50bcb9 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.105246 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.105613 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.106208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:49:38.106208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.106208 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:49:38.106208 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:49:38.142552 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, resource={'id': '4d64a793-ee68-4a18-b938-f55304c6fcf6', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'mtu': 1372, 'status': 'ACTIVE', 'subnets': ['0bc68cc0-48dc-4abe-bbac-0a4f654efb2e'], 'standard_attr_id': 52, 'shared': False, 'availability_zone_hints': [], 'availability_zones': [], 'ipv4_address_scope': None, 'ipv6_address_scope': None, 'router:external': False, 'qinq': False, 'vlan_transparent': False, 'description': '', 'port_security_enabled': True, 'tags': [], 'created_at': '2026-03-19T18:14:20Z', 'updated_at': '2026-03-19T18:14:21Z', 'revision_number': 2, 'provider:network_type': 'geneve', 'provider:physical_network': None, 'provider:segmentation_id': 59295}, resource_type=networks, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.143516 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Logical_Switch, record=neutron-4d64a793-ee68-4a18-b938-f55304c6fcf6, col_values=(('external_ids', {'neutron:network_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:mtu': '1372', 'neutron:revision_number': '2', 'neutron:availability_zone_hints': '', 'neutron:provnet-network-type': 'geneve'}), ('other_config', {'mcast_snoop': 'false', 'mcast_flood_unregistered': 'false', 'vlan-passthru': 'false'})), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.144081 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLSwitchPortCommand(_result=None, lport=provnet-42ff4b0a-bf0a-4937-bf0f-c8b42f68f267, external_ids_update=None, columns={'tag': 59295}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.144267 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.145463 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:49:38.145463 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.145463 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:38.145463 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.145463 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.145463 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:38.145463 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.145463 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource 4d64a793-ee68-4a18-b938-f55304c6fcf6 (type: networks): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2302, in update_network
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.146646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.148132 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.148642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:49:38.148642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.148642 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:49:38.148642 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:49:38.246190 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, resource={'id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'project_id': '4b30465a09a24b85ae0f8a1217f70a89', 'admin_state_up': True, 'status': 'ACTIVE', 'enable_snat': True, 'external_gateway_info': {'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'enable_snat': True}, 'gw_port_id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'description': 'Created by cluster-api-provider-openstack cluster magnum-system-kube-1id6n', 'availability_zones': [], 'distributed': False, 'ha': True, 'ha_vr_id': 0, 'availability_zone_hints': [], 'enable_default_route_ecmp': False, 'enable_default_route_bfd': False, 'external_gateways': [{'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'external_fixed_ips': [{'ip_address': '172.24.5.52', 'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e'}, {'ip_address': '2001:db8::2c3', 'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2'}]}], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:25Z', 'revision_number': 3, 'tenant_id': '4b30465a09a24b85ae0f8a1217f70a89'}, resource_type=routers, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.246623 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterCommand(_result=None, name=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, columns={'external_ids': {'neutron:router_name': 'k8s-clusterapi-cluster-magnum-system-kube-1id6n', 'neutron:revision_number': '3', 'neutron:availability_zone_hints': ''}, 'enabled': True}, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.246792 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'from-lport'), ('priority', '=', 2002), ('match', '=', 'inport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.247090 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=3): QoSDelCommand(_result=None, switch=neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b, conditions=[('direction', '=', 'to-lport'), ('priority', '=', 2002), ('match', '=', 'outport == "f319bf7e-5d34-47af-b620-bec8597c3819"')], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.247292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.248126 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:49:38.248126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.248126 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:38.248126 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.248126 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.248126 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:38.248126 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.248126 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:38.248505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Unable to update router cf5e0251-94c8-4bce-b873-648b8cc72809. Error: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource cf5e0251-94c8-4bce-b873-648b8cc72809 (type: routers): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1609, in update_router
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with excutils.save_and_reraise_exception():
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 267, in __exit__
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.force_reraise()
Mar 19 18:49:38.249591 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise self.value
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1543, in update_router
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:49:38.250454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:49:38.251154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Fixing resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports) at create/update {{(pid=103900) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:399}}
Mar 19 18:49:38.385283 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): CheckRevisionNumberCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, resource={'id': 'f319bf7e-5d34-47af-b620-bec8597c3819', 'name': '', 'network_id': '409b35e2-57e1-45b1-9dfd-29d98c18276b', 'project_id': '', 'mac_address': 'fa:16:3e:11:31:8c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf5e0251-94c8-4bce-b873-648b8cc72809', 'device_owner': 'network:router_gateway', 'standard_attr_id': 57, 'fixed_ips': [{'subnet_id': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e', 'ip_address': '172.24.5.52'}, {'subnet_id': '7888df47-ce34-4091-9e08-c1c5949f53a2', 'ip_address': '2001:db8::2c3'}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'np0000160124', 'binding:vif_type': 'ovs', 'binding:vif_details': {'port_filter': True, 'connectivity': 'l2', 'ovs_create_tap': False, 'bridge_name': 'br-int', 'datapath_type': 'system', 'bound_drivers': {'0': 'ovn'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2026-03-19T18:14:22Z', 'updated_at': '2026-03-19T18:14:24Z', 'revision_number': 5, 'tenant_id': ''}, resource_type=router_ports, if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.386131 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): UpdateLRouterPortCommand(_result=None, name=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, columns={'external_ids': {'neutron:revision_number': '5', 'neutron:subnet_ids': 'b41eb4fe-ef98-4e5a-b3ad-d5b04f24bf1e 7888df47-ce34-4091-9e08-c1c5949f53a2', 'neutron:network_name': 'neutron-409b35e2-57e1-45b1-9dfd-29d98c18276b', 'neutron:is_ext_gw': 'True', 'neutron:router_name': 'neutron-cf5e0251-94c8-4bce-b873-648b8cc72809'}, 'options': {'reside-on-redirect-chassis': 'true', 'gateway_mtu': '1372'}, 'networks': ['2001:db8::2c3/64', '172.24.5.52/24'], 'ipv6_ra_configs': {}}, if_exists=False) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.386711 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): SetLRouterPortInLSwitchPortCommand(_result=None, lswitch_port=f319bf7e-5d34-47af-b620-bec8597c3819, lrouter_port=lrp-f319bf7e-5d34-47af-b620-bec8597c3819, is_gw_port=True, if_exists=True, lsp_address=router) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.387237 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.388532 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Traceback (most recent call last):
Mar 19 18:49:38.388532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.388532 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:38.388532 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.388532 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.388532 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:38.388532 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.388532 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Failed to fix resource f319bf7e-5d34-47af-b620-bec8597c3819 (type: router_ports): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance Traceback (most recent call last):
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 412, in check_for_inconsistencies
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self._fix_create_update(admin_context, row)
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 321, in _fix_create_update
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     res_map['ovn_update'](context, n_obj)
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1946, in update_router_port
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.389898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     next(self.gen)
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     with self.create_transaction(
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     self.result = self.commit()
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                   ^^^^^^^^^^^^^
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise result.ex
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     txn.results.put(txn.do_commit())
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.390147 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.390448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance     raise RuntimeError(msg)
Mar 19 18:49:38.390448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.390448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance 
Mar 19 18:49:38.390448 np0000160124 neutron-ovn-maintenance-worker[103900]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-0e7d5e31-c0eb-475e-8973-0e5e0e1db5f3 None None] Maintenance task: Synchronization completed (took 0.39 seconds)
Mar 19 18:49:38.564908 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:38.566858 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:38.609053 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:38.609553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.610748 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Traceback (most recent call last):
Mar 19 18:49:38.610748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.610748 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:38.610748 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.610748 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.610748 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:38.610748 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.610748 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e27b6139-1454-4729-84e3-26801afc6f34 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.611958 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:38.612529 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:39.136331 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:39.138036 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:39.138465 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:39.138730 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.139732 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:39.139732 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.139732 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:39.139732 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.139732 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.139732 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:39.139732 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.139732 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.141082 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.141983 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:39.142906 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:39.143635 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:39.144091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:39.144308 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.144948 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:39.144948 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.144948 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:39.144948 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.144948 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.144948 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:39.144948 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.144948 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:39.148709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:39.149275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:39.149275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.149275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:39.149275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.149275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.149275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:39.149275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.149275 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:39.151164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.151666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.152404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:39.152404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.152404 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:39.152404 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:39.152404 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:39.152606 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:39.153054 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.153956 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:39.153956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.153956 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:39.153956 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.153956 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.153956 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:39.153956 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.153956 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:39.155718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:39.156222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:39.156222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.156222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:39.156222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.156222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.156222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:39.156222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.156222 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:39.158410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.158974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:39.159505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.159505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:39.159505 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:39.159643 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:39.160762 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:39.161092 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:39.161247 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.161974 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Traceback (most recent call last):
Mar 19 18:49:39.161974 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.161974 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:39.161974 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.161974 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.161974 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:39.161974 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.161974 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-02ba5b73-c592-4a1c-8878-a3769ead78d3 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.163387 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:39.163941 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:43.565576 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:43.566938 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:43.568854 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG dbcounter [-] [103900] Writing DB stats neutron:SELECT=434 {{(pid=103900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Mar 19 18:49:43.614091 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:43.614718 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:43.616103 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:49:43.616103 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:43.616103 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:43.616103 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:43.616103 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:43.616103 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:43.616103 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:43.616103 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:43.617916 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:43.618533 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:44.137067 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:44.138868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:44.139522 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:44.139785 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.140836 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:44.140836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.140836 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:44.140836 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.140836 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.140836 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:44.140836 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.140836 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.143315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.144125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:44.144852 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:44.144852 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:44.145351 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:44.145596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.146178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:44.146178 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.146178 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:44.146178 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.146178 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.146178 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:44.146178 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.146178 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:44.147051 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:44.147924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:44.147924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.147924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:44.147924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.147924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.147924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:44.147924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.147924 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:44.148410 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.149159 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.149914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:44.149914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.149914 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:44.152219 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:44.152564 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:44.153503 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:44.153960 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.155566 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:44.155566 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.155566 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:44.155566 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.155566 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.155566 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:44.155566 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.155566 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:44.157110 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:44.157764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:44.157764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.157764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:44.157764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.157764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.157764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:44.157764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.157764 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:44.159087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.159625 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:44.160154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.160154 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:44.160154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:44.160154 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:44.160868 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:44.161284 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:44.161542 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.162498 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:49:44.162498 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.162498 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:44.162498 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.162498 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.162498 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:44.162498 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.162498 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.163998 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:44.164496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:48.566487 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:48.568547 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:48.607412 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:48.607921 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:48.608988 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:49:48.608988 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:48.608988 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:48.608988 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:48.608988 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:48.608988 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:48.608988 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:48.608988 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:48.610339 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:48.611401 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:49.138023 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:49.139865 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:49.140329 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:49.140623 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.141790 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:49.141790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.141790 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:49.141790 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.141790 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.141790 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:49.141790 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.141790 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.143712 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.144448 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:49.144998 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:49.145589 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:49.146226 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:49.146531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.147330 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:49.147330 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.147330 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:49.147330 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.147330 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.147330 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:49.147330 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.147330 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:49.149341 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:49.150579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:49.150579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.150579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:49.150579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.150579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.150579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:49.150579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.150579 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:49.150896 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.151451 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.152035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:49.152035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.152035 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:49.152641 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:49.153158 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:49.153766 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:49.154178 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.155002 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:49.155002 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.155002 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:49.155002 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.155002 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.155002 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:49.155002 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.155002 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:49.156469 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:49.157622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:49.157622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.157622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:49.157622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.157622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.157622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:49.157622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.157622 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:49.158352 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.159264 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:49.160223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.160223 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:49.160223 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:49.160519 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:49.160939 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:49.161164 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:49.161320 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.161957 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:49:49.161957 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.161957 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:49.161957 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.161957 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.161957 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:49.161957 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.161957 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.163316 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:49.163828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:53.567761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:53.569843 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:53.607788 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:53.608272 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:53.609363 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:49:53.609363 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:53.609363 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:53.609363 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:53.609363 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:53.609363 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:53.609363 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:53.609363 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:53.610711 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:53.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:54.138753 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:54.140430 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:54.140678 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:54.141052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.141587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:54.141587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.141587 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:54.141587 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.141587 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.141587 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:54.141587 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.141587 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.143737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.144319 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:54.145390 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:54.145774 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:54.146197 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:54.146412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.147087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:54.147087 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.147087 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:54.147087 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.147087 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.147087 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:54.147087 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.147087 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:54.147831 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:54.148905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:54.148905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.148905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:54.148905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.148905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.148905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:54.148905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.148905 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:54.149412 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.149950 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.150461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:54.150461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.150461 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:54.153031 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:54.153313 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:54.154110 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:54.154443 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.155225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:54.155225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.155225 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:54.155225 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.155225 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.155225 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:54.155225 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.155225 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:54.156259 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:54.156596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:54.156596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.156596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:54.156596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.156596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.156596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:54.156596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.156596 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:54.158414 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.158795 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:54.159179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.159179 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:54.160342 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:54.161029 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:54.161291 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:54.161518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:54.161734 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.162454 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:49:54.162454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.162454 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:54.162454 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.162454 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.162454 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:54.162454 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.162454 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.163514 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:54.164057 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:58.568397 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:58.570007 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:58.608683 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:58.609060 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:58.610042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:49:58.610042 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:58.610042 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:58.610042 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:58.610042 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:58.610042 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:58.610042 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:58.610042 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:58.611397 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:58.612334 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:59.139714 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:59.141531 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:59.141928 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:59.142212 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.143403 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:59.143403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.143403 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:59.143403 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.143403 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.143403 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:59.143403 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.143403 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.144947 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.145496 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:59.145998 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:59.146440 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:49:59.147136 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:59.147811 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.148492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:59.148492 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.148492 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:59.148492 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.148492 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.148492 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:59.148492 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.148492 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:59.149646 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:59.150243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:59.150243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.150243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:59.150243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.150243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.150243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:59.150243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.150243 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:49:59.150699 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.151236 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.151717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:59.151717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.151717 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:59.153349 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:59.153698 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:59.154143 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:59.154364 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.155017 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:49:59.155017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.155017 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:59.155017 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.155017 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.155017 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:59.155017 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.155017 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:49:59.156283 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:59.156720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:49:59.156720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.156720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:49:59.156720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.156720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.156720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:49:59.156720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.156720 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:49:59.158011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.158530 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:59.159145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.159145 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:49:59.160771 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:49:59.161636 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:49:59.162314 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:59.162552 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:49:59.162756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:49:59.165385 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:49:59.166332 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:49:59.167268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:49:59.167268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:49:59.167268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:49:59.167268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:49:59.167268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:49:59.167268 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:03.569303 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:03.570701 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:03.603871 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:03.604581 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:03.606505 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:50:03.606505 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:03.606505 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:03.606505 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:03.606505 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:03.606505 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:03.606505 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:03.606505 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:03.606902 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:03.607503 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:04.140628 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:04.141973 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:04.142294 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:04.142464 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.143290 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:04.143290 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.143290 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:04.143290 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.143290 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.143290 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:04.143290 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.143290 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.144664 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.145067 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:04.146490 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:04.146812 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:50:04.147316 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:04.147635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.148744 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:04.148744 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.148744 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:04.148744 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.148744 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.148744 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:04.148744 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.148744 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:04.150152 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:04.150632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:04.150632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.150632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:04.150632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.150632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.150632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:04.150632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.150632 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:50:04.151260 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.151583 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.151938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:04.151938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.151938 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:04.153693 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:04.154055 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:04.154626 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:04.155225 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.156065 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:04.156065 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.156065 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:04.156065 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.156065 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.156065 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:04.156065 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.156065 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:04.156951 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:04.157292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:04.157292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.157292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:04.157292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.157292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.157292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:04.157292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.157292 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:50:04.158173 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.158556 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:04.158969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.158969 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:04.161274 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:04.162296 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:04.162900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:04.163111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:04.163265 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.164001 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:50:04.164001 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.164001 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:04.164001 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.164001 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.164001 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:04.164001 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.164001 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.166137 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:04.166517 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:08.570275 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:08.571953 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:08.609740 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:08.610199 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:08.610897 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:50:08.610897 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:08.610897 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:08.610897 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:08.610897 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:08.610897 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:08.610897 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:08.610897 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:08.611704 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:08.612832 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:09.141397 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:09.143034 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:09.143483 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:09.143843 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.144752 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:09.144752 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.144752 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:09.144752 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.144752 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.144752 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:09.144752 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.144752 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.146670 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.147315 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:09.147873 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:09.147873 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:50:09.148265 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:09.148483 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.149164 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:09.149164 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.149164 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:09.149164 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.149164 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.149164 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:09.149164 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.149164 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:09.150749 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:09.151635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:09.151635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.151635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:09.151635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.151635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.151635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:09.151635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.151635 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:50:09.152531 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.153348 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.154019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:09.154019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.154019 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:09.154499 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:09.154601 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:09.155008 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:09.155318 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.155809 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:09.155809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.155809 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:09.155809 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.155809 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.155809 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:09.155809 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.155809 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:09.157042 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:09.158266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:09.158266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.158266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:09.158266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.158266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.158266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:09.158266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.158266 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:50:09.158817 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.160116 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:09.161424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.161424 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:09.161757 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:09.162637 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:09.163151 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:09.163573 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:09.163721 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.164511 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:50:09.164511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.164511 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:09.164511 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.164511 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.164511 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:09.164511 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.164511 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.165626 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:09.166125 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:13.570974 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:13.572243 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:13.610398 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:13.610737 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:13.612287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:50:13.612287 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:13.612287 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:13.612287 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:13.612287 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:13.612287 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:13.612287 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:13.612287 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:13.614678 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:13.616097 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:14.142185 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:14.143466 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:14.143926 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:14.144201 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.145174 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:14.145174 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.145174 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:14.145174 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.145174 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.145174 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:14.145174 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.145174 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.147333 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.147953 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:14.148651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:14.148651 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:50:14.148787 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:14.149343 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.149816 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:14.149816 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.149816 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:14.149816 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.149816 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.149816 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:14.149816 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.149816 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:14.150666 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:14.151263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:14.151263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.151263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:14.151263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.151263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.151263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:14.151263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.151263 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:50:14.151521 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.152095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.152709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:14.152709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.152709 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:14.154622 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:14.154960 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:14.155511 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:14.155986 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.156725 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:14.156725 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.156725 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:14.156725 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.156725 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.156725 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:14.156725 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.156725 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:14.157562 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:14.158016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:14.158016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.158016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:14.158016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.158016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.158016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:14.158016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.158016 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:50:14.158553 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.159044 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:14.159546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.159546 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:14.162350 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:14.162954 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:14.163253 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:14.163630 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:14.163965 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.164967 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:50:14.164967 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.164967 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:14.164967 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.164967 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.164967 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:14.164967 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.164967 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.165861 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:14.166728 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:18.571592 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:18.573518 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:18.608679 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:18.609056 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:18.610095 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:50:18.610095 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:18.610095 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:18.610095 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:18.610095 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:18.610095 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:18.610095 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:18.610095 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:18.611089 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:18.612024 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:19.143000 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:19.144369 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:19.144680 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:19.145005 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.145930 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:19.145930 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.145930 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:19.145930 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.145930 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.145930 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:19.145930 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.145930 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.147739 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.148543 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:19.149111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:19.149111 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:50:19.149405 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:19.149692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.150438 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:19.150438 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.150438 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:19.150438 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.150438 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.150438 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:19.150438 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.150438 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:19.151959 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:19.152550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:19.152550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.152550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:19.152550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.152550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.152550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:19.152550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.152550 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:50:19.153492 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.154120 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.154688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:19.154688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.154688 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:19.155156 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:19.155515 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:19.156099 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:19.156488 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.157279 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:19.157279 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.157279 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:19.157279 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.157279 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.157279 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:19.157279 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.157279 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:19.158350 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:19.158828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:19.158828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.158828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:19.158828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.158828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.158828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:19.158828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.158828 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:50:19.159502 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.160063 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:19.161021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.161021 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:19.162726 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:19.163577 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:19.164006 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:19.164250 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:19.164520 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.165074 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:50:19.165074 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.165074 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:19.165074 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.165074 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.165074 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:19.165074 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.165074 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.166597 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:19.167651 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:23.572500 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:23.574225 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:23.612658 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:23.613282 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:23.614440 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:50:23.614440 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:23.614440 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:23.614440 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:23.614440 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:23.614440 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:23.614440 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:23.614440 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:23.615771 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:23.616418 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:24.143761 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:24.145472 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:24.145900 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:24.146170 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.147249 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:24.147249 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.147249 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:24.147249 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.147249 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.147249 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:24.147249 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.147249 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.149202 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.150020 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:24.150827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:24.150827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:50:24.150827 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:24.150827 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.151329 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:24.151329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.151329 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:24.151329 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.151329 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.151329 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:24.151329 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.151329 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:24.152620 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:24.153359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:24.153359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.153359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:24.153359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.153359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.153359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:24.153359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.153359 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:50:24.154288 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.154822 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.155429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:24.155429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.155429 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:24.155629 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:24.156109 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:24.156523 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:24.156787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.157381 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:24.157381 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.157381 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:24.157381 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.157381 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.157381 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:24.157381 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.157381 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:24.158557 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:24.159069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:24.159069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.159069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:24.159069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.159069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.159069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:24.159069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.159069 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:50:24.160261 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.160853 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:24.161452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.161452 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:24.163238 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:24.163627 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:24.164056 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:24.164289 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:24.164449 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.165087 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:50:24.165087 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.165087 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:24.165087 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.165087 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.165087 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:24.165087 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.165087 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.166351 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:24.167006 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:28.573255 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:28.574645 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:28.610299 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:28.610991 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:28.611756 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:50:28.611756 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:28.611756 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:28.611756 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:28.611756 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:28.611756 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:28.611756 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:28.611756 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:28.613273 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:28.614487 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:29.144597 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:29.146386 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-1d7a9767-401e-4039-9ed1-c66e29e6fb30, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:29.146732 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DelStaticRoutesCommand(_result=None, lrouter=neutron-cf5e0251-94c8-4bce-b873-648b8cc72809, routes=[], if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:29.146970 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.147787 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:29.147787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.147787 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:29.147787 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.147787 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.147787 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:29.147787 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.147787 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 873, in check_router_default_route_empty_dst_ip
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.149695 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.150681 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:29.151568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:29.151568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=103900) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1072}}
Mar 19 18:50:29.151568 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:29.151568 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.152011 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:29.152011 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.152011 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:29.152011 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.152011 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.152011 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:29.152011 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.152011 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:29.153052 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:29.153604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:29.153604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.153604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:29.153604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.153604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.153604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:29.153604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.153604 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1076, in set_fip_distributed_flag
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute(
Mar 19 18:50:29.154624 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                                                           ^^^^^^^^
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.155161 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.155692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:29.155692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.155692 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:29.156064 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:29.156790 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:29.157162 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'bfd-min-rx': '1000', 'bfd-min-tx': '100', 'bfd-mult': '3'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:29.157436 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last):
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last):
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     next(self.gen)
Mar 19 18:50:29.160287 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     with self.create_transaction(
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     self.result = self.commit()
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                   ^^^^^^^^^^^^^
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise result.ex
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     txn.results.put(txn.do_commit())
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command     raise RuntimeError(msg)
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.command 
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_ha_failover' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.160898 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1131, in update_ha_failover
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self._nb_idl.set_nb_global_options(**options).execute(
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.api.transaction(check_error, log_errors, **kwargs) as t:
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:29.161355 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.161923 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:29.163654 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:29.164139 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:29.164668 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:29.165142 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=300) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:29.165441 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.166296 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Traceback (most recent call last):
Mar 19 18:50:29.166296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.166296 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:29.166296 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.166296 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.166296 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:29.166296 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.166296 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-e804b062-0765-4ca0-a8fd-2da76c75608d None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 795, in update_mac_aging_settings
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.167971 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:29.168587 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics 
Mar 19 18:50:33.573976 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=103900) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}}
Mar 19 18:50:33.575727 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=103900) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:950}}
Mar 19 18:50:33.615443 np0000160124 neutron-ovn-maintenance-worker[103900]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=103900) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Mar 19 18:50:33.616045 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:33.617040 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Traceback (most recent call last):
Mar 19 18:50:33.617040 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:33.617040 np0000160124 neutron-ovn-maintenance-worker[103900]:     txn.results.put(txn.do_commit())
Mar 19 18:50:33.617040 np0000160124 neutron-ovn-maintenance-worker[103900]:                     ^^^^^^^^^^^^^^^
Mar 19 18:50:33.617040 np0000160124 neutron-ovn-maintenance-worker[103900]:   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:33.617040 np0000160124 neutron-ovn-maintenance-worker[103900]:     raise RuntimeError(msg)
Mar 19 18:50:33.617040 np0000160124 neutron-ovn-maintenance-worker[103900]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:33.617040 np0000160124 neutron-ovn-maintenance-worker[103900]: 
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics [None req-83c7361c-97ff-4960-8969-0b513b03d3e6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics Traceback (most recent call last):
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     work()
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return self.callback(*self.args, **self.kwargs)
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(*args, **kwargs)
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 84, in decorator
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     return f(self, *args, **kwargs)
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics            ^^^^^^^^^^^^^^^^^^^^^^^^
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 781, in check_fdb_aging_settings
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self._nb_idl.transaction(check_error=True) as txn:
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:33.618254 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with super().transaction(*args, **kwargs) as t:
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     next(self.gen)
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     with self.create_transaction(
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     self.result = self.commit()
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                   ^^^^^^^^^^^^^
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise result.ex
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     txn.results.put(txn.do_commit())
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics                     ^^^^^^^^^^^^^^^
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics   File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics     raise RuntimeError(msg)
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it
Mar 19 18:50:33.619803 np0000160124 neutron-ovn-maintenance-worker[103900]: ERROR futurist.periodics